Jul 25 16:41:34 user nova-compute[70659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 25 16:41:36 user nova-compute[70659]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70659) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 25 16:41:36 user nova-compute[70659]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70659) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 25 16:41:36 user nova-compute[70659]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70659) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 25 16:41:36 user nova-compute[70659]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:41:37 user nova-compute[70659]: INFO nova.virt.driver [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 25 16:41:37 user nova-compute[70659]: INFO nova.compute.provider_config [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] Acquiring lock "singleton_lock" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] Acquired lock "singleton_lock" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] Releasing lock "singleton_lock" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] Full set of CONF: {{(pid=70659) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ******************************************************************************** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] Configuration options gathered from: {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ================================================================================ {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] allow_resize_to_same_host      = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] arq_binding_timeout            = 300 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] backdoor_port                  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] backdoor_socket                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] block_device_allocate_retries  = 300 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] block_device_allocate_retries_interval = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cert                           = self.pem {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute_monitors               = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] config_dir                     = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] config_drive_format            = iso9660 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] config_source                  = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] console_host                   = user {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] control_exchange               = nova {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cpu_allocation_ratio           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] daemon                         = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] debug                          = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] default_access_ip_network_name = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] default_availability_zone      = nova {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] default_ephemeral_format       = ext4 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] default_schedule_zone          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] disk_allocation_ratio          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] enable_new_services            = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] enabled_apis                   = ['osapi_compute'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] enabled_ssl_apis               = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] flat_injected                  = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] force_config_drive             = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] force_raw_images               = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] graceful_shutdown_timeout      = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] heal_instance_info_cache_interval = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] host                           = user {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] instance_build_timeout         = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] instance_delete_interval       = 300 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] instance_name_template         = instance-%08x {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] instance_usage_audit           = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] instance_usage_audit_period    = month {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] internal_service_availability_zone = internal {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] key                            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] live_migration_retry_count     = 30 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] log_config_append              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] log_dir                        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] log_file                       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] log_options                    = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] log_rotate_interval            = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] log_rotate_interval_type       = days {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] log_rotation_type              = none {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] long_rpc_timeout               = 1800 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] max_concurrent_builds          = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] max_concurrent_live_migrations = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] max_concurrent_snapshots       = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] max_local_block_devices        = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] max_logfile_count              = 30 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] max_logfile_size_mb            = 200 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] maximum_instance_delete_attempts = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] metadata_listen                = 0.0.0.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] metadata_listen_port           = 8775 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] metadata_workers               = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] migrate_max_retries            = -1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] mkisofs_cmd                    = genisoimage {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] my_ip                          = 10.0.0.210 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] network_allocate_retries       = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] osapi_compute_listen_port      = 8774 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] osapi_compute_unique_server_name_scope =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] osapi_compute_workers          = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] password_length                = 12 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] periodic_enable                = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] periodic_fuzzy_delay           = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] pointer_model                  = ps2mouse {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] preallocate_images             = none {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] publish_errors                 = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] pybasedir                      = /opt/stack/nova {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ram_allocation_ratio           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] rate_limit_burst               = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] rate_limit_except_level        = CRITICAL {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] rate_limit_interval            = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] reboot_timeout                 = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] reclaim_instance_interval      = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] record                         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] reimage_timeout_per_gb         = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] report_interval                = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] rescue_timeout                 = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] reserved_host_cpus             = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] reserved_host_disk_mb          = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] reserved_host_memory_mb        = 512 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] reserved_huge_pages            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] resize_confirm_window          = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] resize_fs_using_block_device   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] resume_guests_state_on_host_boot = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] rpc_response_timeout           = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] run_external_periodic_tasks    = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] running_deleted_instance_action = reap {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] running_deleted_instance_poll_interval = 1800 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] running_deleted_instance_timeout = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler_instance_sync_interval = 120 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_down_time              = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] servicegroup_driver            = db {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] shelved_offload_time           = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] shelved_poll_interval          = 3600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] shutdown_timeout               = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] source_is_ipv6                 = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ssl_only                       = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] state_path                     = /opt/stack/data/nova {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] sync_power_state_interval      = 600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] sync_power_state_pool_size     = 1000 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] syslog_log_facility            = LOG_USER {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] tempdir                        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] timeout_nbd                    = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] transport_url                  = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] update_resources_interval      = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] use_cow_images                 = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] use_eventlog                   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] use_journal                    = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] use_json                       = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] use_rootwrap_daemon            = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] use_stderr                     = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] use_syslog                     = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vcpu_pin_set                   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plugging_is_fatal          = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plugging_timeout           = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] virt_mkfs                      = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] volume_usage_poll_interval     = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] watch_log_file                 = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] web                            = /usr/share/spice-html5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_concurrency.disable_process_locking = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.auth_strategy              = keystone {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.compute_link_prefix        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.dhcp_domain                = novalocal {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.enable_instance_password   = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.glance_link_prefix         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.instance_list_per_project_cells = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.list_records_by_skipping_down_cells = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.local_metadata_per_cell    = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.max_limit                  = 1000 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.metadata_cache_expiration  = 15 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.neutron_default_tenant_id  = default {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.use_forwarded_for          = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.use_neutron_default_nets   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.vendordata_dynamic_targets = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.vendordata_jsonfile_path   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.backend                  = dogpile.cache.memcached {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.backend_argument         = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.config_prefix            = cache.oslo {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.dead_timeout             = 60.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.debug_cache_backend      = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.enable_retry_client      = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.enable_socket_keepalive  = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.enabled                  = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.expiration_time          = 600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.hashclient_retry_attempts = 2 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_dead_retry      = 300 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_password        =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_sasl_enabled    = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.memcache_username        =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.proxies                  = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.retry_attempts           = 2 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.retry_delay              = 0.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.socket_keepalive_count   = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.socket_keepalive_idle    = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.socket_keepalive_interval = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.tls_allowed_ciphers      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.tls_cafile               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.tls_certfile             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.tls_enabled              = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cache.tls_keyfile              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.auth_section            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.auth_type               = password {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.cafile                  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.certfile                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.collect_timing          = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.cross_az_attach         = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.debug                   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.endpoint_template       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.http_retries            = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.insecure                = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.keyfile                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.os_region_name          = RegionOne {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.split_loggers           = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cinder.timeout                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.cpu_dedicated_set      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.cpu_shared_set         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.image_type_exclude_list = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.max_concurrent_disk_ops = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.max_disk_devices_to_attach = -1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.resource_provider_association_refresh = 300 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.shutdown_retry_interval = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] conductor.workers              = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] console.allowed_origins        = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] console.ssl_ciphers            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] console.ssl_minimum_version    = default {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] consoleauth.token_ttl          = 600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.cafile                  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.certfile                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.collect_timing          = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.connect_retries         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.connect_retry_delay     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.endpoint_override       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.insecure                = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.keyfile                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.max_version             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.min_version             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.region_name             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.service_name            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.service_type            = accelerator {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.split_loggers           = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.status_code_retries     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.status_code_retry_delay = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.timeout                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] cyborg.version                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.backend               = sqlalchemy {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.connection            = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.connection_debug      = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.connection_parameters =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.connection_recycle_time = 3600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.connection_trace      = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.db_inc_retry_interval = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.db_max_retries        = 20 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.db_max_retry_interval = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.db_retry_interval     = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.max_overflow          = 50 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.max_pool_size         = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.max_retries           = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.mysql_enable_ndb      = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.mysql_wsrep_sync_wait = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.pool_timeout          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.retry_interval        = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.slave_connection      = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] database.sqlite_synchronous    = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.backend           = sqlalchemy {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.connection        = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.connection_debug  = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.connection_parameters =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.connection_recycle_time = 3600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.connection_trace  = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.db_inc_retry_interval = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.db_max_retries    = 20 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.db_max_retry_interval = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.db_retry_interval = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.max_overflow      = 50 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.max_pool_size     = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.max_retries       = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.mysql_enable_ndb  = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.pool_timeout      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.retry_interval    = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.slave_connection  = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] api_database.sqlite_synchronous = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] devices.enabled_mdev_types     = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ephemeral_storage_encryption.enabled = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.api_servers             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.cafile                  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.certfile                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.collect_timing          = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.connect_retries         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.connect_retry_delay     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.debug                   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.default_trusted_certificate_ids = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.enable_certificate_validation = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.enable_rbd_download     = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.endpoint_override       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.insecure                = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.keyfile                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.max_version             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.min_version             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.num_retries             = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.rbd_ceph_conf           =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.rbd_connect_timeout     = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.rbd_pool                =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.rbd_user                =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.region_name             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.service_name            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.service_type            = image {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.split_loggers           = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.status_code_retries     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.status_code_retry_delay = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.timeout                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.verify_glance_signatures = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] glance.version                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] guestfs.debug                  = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.config_drive_cdrom      = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.config_drive_inject_password = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.enable_instance_metrics_collection = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.enable_remotefx         = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.instances_path_share    =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.iscsi_initiator_list    = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.limit_cpu_features      = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.power_state_check_timeframe = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.use_multipath_io        = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.volume_attach_retry_count = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.vswitch_name            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] mks.enabled                    = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] image_cache.manager_interval   = 2400 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] image_cache.precache_concurrency = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] image_cache.remove_unused_base_images = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] image_cache.subdirectory_name  = _base {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.api_max_retries         = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.api_retry_interval      = 2 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.auth_section            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.auth_type               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.cafile                  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.certfile                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.collect_timing          = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.connect_retries         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.connect_retry_delay     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.endpoint_override       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.insecure                = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.keyfile                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.max_version             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.min_version             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.partition_key           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.peer_list               = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.region_name             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.serial_console_state_timeout = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.service_name            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.service_type            = baremetal {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.split_loggers           = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.status_code_retries     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.status_code_retry_delay = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.timeout                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ironic.version                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] key_manager.fixed_key          = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.barbican_api_version  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.barbican_endpoint     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.barbican_endpoint_type = public {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.barbican_region_name  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.cafile                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.certfile              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.collect_timing        = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.insecure              = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.keyfile               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.number_of_retries     = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.retry_delay           = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.send_service_user_token = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.split_loggers         = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.timeout               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.verify_ssl            = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican.verify_ssl_path       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican_service_user.auth_section = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican_service_user.auth_type = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican_service_user.cafile   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican_service_user.certfile = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican_service_user.collect_timing = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican_service_user.insecure = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican_service_user.keyfile  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican_service_user.split_loggers = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] barbican_service_user.timeout  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.approle_role_id          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.approle_secret_id        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.cafile                   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.certfile                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.collect_timing           = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.insecure                 = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.keyfile                  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.kv_mountpoint            = secret {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.kv_version               = 2 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.namespace                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.root_token_id            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.split_loggers            = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.ssl_ca_crt_file          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.timeout                  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.use_ssl                  = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.cafile                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.certfile              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.collect_timing        = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.connect_retries       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.connect_retry_delay   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.endpoint_override     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.insecure              = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.keyfile               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.max_version           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.min_version           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.region_name           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.service_name          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.service_type          = identity {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.split_loggers         = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.status_code_retries   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.status_code_retry_delay = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.timeout               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] keystone.version               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.connection_uri         =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.cpu_mode               = custom {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: WARNING oslo_config.cfg [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.cpu_power_governor_high = performance {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.cpu_power_governor_low = powersave {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.cpu_power_management   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.device_detach_attempts = 8 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.device_detach_timeout  = 20 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.disk_cachemodes        = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.disk_prefix            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.enabled_perf_events    = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.file_backed_memory     = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.gid_maps               = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.hw_disk_discard        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.hw_machine_type        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.images_rbd_glance_store_name =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.images_rbd_pool        = rbd {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.images_type            = default {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.images_volume_group    = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.inject_key             = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.inject_partition       = -2 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.inject_password        = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.iscsi_iface            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.iser_use_multipath     = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_bandwidth = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_downtime = 500 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_inbound_addr = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_permit_post_copy = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_scheme  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_timeout_action = abort {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_tunnelled = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: WARNING oslo_config.cfg [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 25 16:41:37 user nova-compute[70659]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 25 16:41:37 user nova-compute[70659]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 25 16:41:37 user nova-compute[70659]: and ``live_migration_inbound_addr`` respectively.
Jul 25 16:41:37 user nova-compute[70659]: ).  Its value may be silently ignored in the future.
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.live_migration_with_native_tls = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.max_queues             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.nfs_mount_options      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.num_memory_encrypted_guests = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.num_pcie_ports         = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.pmem_namespaces        = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.quobyte_client_cfg     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rbd_secret_uuid        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rbd_user               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.remote_filesystem_transport = ssh {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rescue_image_id        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rescue_kernel_id       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rescue_ramdisk_id      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.rx_queue_size          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.smbfs_mount_options    =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.snapshot_compression   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.snapshot_image_format  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.sparse_logical_volumes = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.swtpm_enabled          = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.swtpm_group            = tss {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.swtpm_user             = tss {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.sysinfo_serial         = unique {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.tb_cache_size          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.tx_queue_size          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.uid_maps               = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.use_virtio_for_bridges = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.virt_type              = kvm {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.volume_clear           = zero {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.volume_clear_size      = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.volume_use_multipath   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.vzstorage_cache_path   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.vzstorage_mount_user   = stack {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.auth_section           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.auth_type              = password {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.cafile                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.certfile               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.collect_timing         = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.connect_retries        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.connect_retry_delay    = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.default_floating_pool  = public {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.endpoint_override      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.extension_sync_interval = 600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.http_retries           = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.insecure               = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.keyfile                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.max_version            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.min_version            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.ovs_bridge             = br-int {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.physnets               = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.region_name            = RegionOne {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.service_metadata_proxy = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.service_name           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.service_type           = network {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.split_loggers          = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.status_code_retries    = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.status_code_retry_delay = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.timeout                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] neutron.version                = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] notifications.bdms_in_notifications = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] notifications.default_level    = INFO {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] notifications.notification_format = unversioned {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] notifications.notify_on_state_change = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] pci.alias                      = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] pci.device_spec                = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] pci.report_in_placement        = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.auth_section         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.auth_type            = password {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.cafile               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.certfile             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.collect_timing       = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.connect_retries      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.connect_retry_delay  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.default_domain_id    = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.default_domain_name  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.domain_id            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.domain_name          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.endpoint_override    = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.insecure             = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.keyfile              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.max_version          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.min_version          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.password             = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.project_domain_id    = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.project_domain_name  = Default {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.project_id           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.project_name         = service {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.region_name          = RegionOne {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.service_name         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.service_type         = placement {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.split_loggers        = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.status_code_retries  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.status_code_retry_delay = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.system_scope         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.timeout              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.trust_id             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.user_domain_id       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.user_domain_name     = Default {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.user_id              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.username             = placement {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] placement.version              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.cores                    = 20 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.count_usage_from_placement = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.injected_file_content_bytes = 10240 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.injected_file_path_length = 255 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.injected_files           = 5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.instances                = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.key_pairs                = 100 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.metadata_items           = 128 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.ram                      = 51200 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.recheck_quota            = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.server_group_members     = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] quota.server_groups            = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] rdp.enabled                    = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.image_metadata_prefilter = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.max_attempts         = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.max_placement_results = 1000 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.query_placement_for_availability_zone = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.query_placement_for_image_type_support = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] scheduler.workers              = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.host_subset_size = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.isolated_hosts = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.isolated_images = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.pci_in_placement = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.track_instance_changes = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] metrics.required               = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] metrics.weight_multiplier      = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] metrics.weight_setting         = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] serial_console.enabled         = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] serial_console.port_range      = 10000:20000 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] serial_console.serialproxy_port = 6083 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.auth_section      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.auth_type         = password {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.cafile            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.certfile          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.collect_timing    = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.insecure          = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.keyfile           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.send_service_user_token = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.split_loggers     = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] service_user.timeout           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.agent_enabled            = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.enabled                  = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.html5proxy_port          = 6082 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.image_compression        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.jpeg_compression         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.playback_compression     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.server_listen            = 127.0.0.1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.streaming_mode           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] spice.zlib_compression         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] upgrade_levels.baseapi         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] upgrade_levels.cert            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] upgrade_levels.compute         = auto {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] upgrade_levels.conductor       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] upgrade_levels.scheduler       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vendordata_dynamic_auth.auth_section = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vendordata_dynamic_auth.auth_type = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vendordata_dynamic_auth.cafile = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vendordata_dynamic_auth.certfile = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vendordata_dynamic_auth.insecure = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vendordata_dynamic_auth.keyfile = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vendordata_dynamic_auth.timeout = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.api_retry_count         = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.ca_file                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.cache_prefix            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.cluster_name            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.connection_pool_size    = 10 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.console_delay_seconds   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.datastore_regex         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.host_ip                 = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.host_password           = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.host_port               = 443 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.host_username           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.insecure                = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.integration_bridge      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.maximum_objects         = 100 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.pbm_default_policy      = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.pbm_enabled             = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.pbm_wsdl_location       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.serial_port_proxy_uri   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.serial_port_service_uri = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.task_poll_interval      = 0.5 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.use_linked_clone        = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.vnc_keymap              = en-us {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.vnc_port                = 5900 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vmware.vnc_port_total          = 10000 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.auth_schemes               = ['none'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.enabled                    = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.novncproxy_port            = 6080 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.server_listen              = 0.0.0.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.vencrypt_ca_certs          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.vencrypt_client_cert       = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vnc.vencrypt_client_key        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.disable_rootwrap   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.enable_numa_live_migration = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.libvirt_disable_apic = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.client_socket_timeout     = 900 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.default_pool_size         = 1000 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.keep_alive                = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.max_header_line           = 16384 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.ssl_ca_file               = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.ssl_cert_file             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.ssl_key_file              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.tcp_keepidle              = 600 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] zvm.ca_file                    = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] zvm.cloud_connector_url        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] zvm.reachable_timeout          = 300 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.enforce_new_defaults = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.enforce_scope      = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.policy_default_rule = default {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.connection_string     = messaging:// {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.enabled               = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.es_doc_type           = notification {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.es_scroll_size        = 10000 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.es_scroll_time        = 2m {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.filter_error_trace    = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.hmac_keys             = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.sentinel_service_name = mymaster {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.socket_timeout        = 0.1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.trace_requests        = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler.trace_sqlalchemy      = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler_jaeger.process_tags   = {} {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler_jaeger.service_name_prefix = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] profiler_otlp.service_name_prefix = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] remote_debug.host              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] remote_debug.port              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_notifications.retry = -1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.auth_section        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.auth_type           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.cafile              = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.certfile            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.collect_timing      = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.connect_retries     = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.connect_retry_delay = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.endpoint_id         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.endpoint_override   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.insecure            = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.keyfile             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.max_version         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.min_version         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.region_name         = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.service_name        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.service_type        = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.split_loggers       = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.status_code_retries = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.status_code_retry_delay = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.timeout             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.valid_interfaces    = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_limit.version             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_reports.file_event_handler = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] oslo_reports.log_dir           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_ovs_privileged.group  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] vif_plug_ovs_privileged.user   = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_linux_bridge.flat_interface = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_ovs.isolate_vif         = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_vif_ovs.per_port_bridge     = False {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] os_brick.lock_path             = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] privsep_osbrick.capabilities   = [21] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] privsep_osbrick.group          = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] privsep_osbrick.helper_command = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] privsep_osbrick.user           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] nova_sys_admin.group           = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] nova_sys_admin.helper_command  = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] nova_sys_admin.user            = None {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG oslo_service.service [None req-341ec828-6fd6-4d57-8311-49ad82a7b5b9 None None] ******************************************************************************** {{(pid=70659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 25 16:41:37 user nova-compute[70659]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 25 16:41:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Starting native event thread {{(pid=70659) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Starting green dispatch thread {{(pid=70659) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Starting connection event dispatch thread {{(pid=70659) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Connecting to libvirt: qemu:///system {{(pid=70659) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fdd32bab580> {{(pid=70659) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 25 16:41:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fdd32bab580> {{(pid=70659) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 25 16:41:37 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Connection event '1' reason 'None'
Jul 25 16:41:37 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 25 16:41:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.mount [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Initialising _HostMountState generation 0 {{(pid=70659) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 25 16:41:44 user nova-compute[70659]: INFO nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt host capabilities <capabilities>
Jul 25 16:41:44 user nova-compute[70659]:   <host>
Jul 25 16:41:44 user nova-compute[70659]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 25 16:41:44 user nova-compute[70659]:     <cpu>
Jul 25 16:41:44 user nova-compute[70659]:       <arch>x86_64</arch>
Jul 25 16:41:44 user nova-compute[70659]:       <model>IvyBridge-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <vendor>Intel</vendor>
Jul 25 16:41:44 user nova-compute[70659]:       <microcode version='1070'/>
Jul 25 16:41:44 user nova-compute[70659]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 25 16:41:44 user nova-compute[70659]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='ss'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='vmx'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='pcid'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='osxsave'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='hypervisor'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='arat'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='tsc_adjust'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='md-clear'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='stibp'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='arch-capabilities'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='ssbd'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='invtsc'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='rsba'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature name='skip-l1dfl-vmentry'/>
Jul 25 16:41:44 user nova-compute[70659]:       <pages unit='KiB' size='4'/>
Jul 25 16:41:44 user nova-compute[70659]:       <pages unit='KiB' size='2048'/>
Jul 25 16:41:44 user nova-compute[70659]:     </cpu>
Jul 25 16:41:44 user nova-compute[70659]:     <power_management>
Jul 25 16:41:44 user nova-compute[70659]:       <suspend_mem/>
Jul 25 16:41:44 user nova-compute[70659]:       <suspend_disk/>
Jul 25 16:41:44 user nova-compute[70659]:       <suspend_hybrid/>
Jul 25 16:41:44 user nova-compute[70659]:     </power_management>
Jul 25 16:41:44 user nova-compute[70659]:     <iommu support='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     <migration_features>
Jul 25 16:41:44 user nova-compute[70659]:       <live/>
Jul 25 16:41:44 user nova-compute[70659]:       <uri_transports>
Jul 25 16:41:44 user nova-compute[70659]:         <uri_transport>tcp</uri_transport>
Jul 25 16:41:44 user nova-compute[70659]:         <uri_transport>rdma</uri_transport>
Jul 25 16:41:44 user nova-compute[70659]:       </uri_transports>
Jul 25 16:41:44 user nova-compute[70659]:     </migration_features>
Jul 25 16:41:44 user nova-compute[70659]:     <topology>
Jul 25 16:41:44 user nova-compute[70659]:       <cells num='2'>
Jul 25 16:41:44 user nova-compute[70659]:         <cell id='0'>
Jul 25 16:41:44 user nova-compute[70659]:           <memory unit='KiB'>8140616</memory>
Jul 25 16:41:44 user nova-compute[70659]:           <pages unit='KiB' size='4'>2035154</pages>
Jul 25 16:41:44 user nova-compute[70659]:           <pages unit='KiB' size='2048'>0</pages>
Jul 25 16:41:44 user nova-compute[70659]:           <distances>
Jul 25 16:41:44 user nova-compute[70659]:             <sibling id='0' value='10'/>
Jul 25 16:41:44 user nova-compute[70659]:             <sibling id='1' value='20'/>
Jul 25 16:41:44 user nova-compute[70659]:           </distances>
Jul 25 16:41:44 user nova-compute[70659]:           <cpus num='6'>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 25 16:41:44 user nova-compute[70659]:           </cpus>
Jul 25 16:41:44 user nova-compute[70659]:         </cell>
Jul 25 16:41:44 user nova-compute[70659]:         <cell id='1'>
Jul 25 16:41:44 user nova-compute[70659]:           <memory unit='KiB'>8255100</memory>
Jul 25 16:41:44 user nova-compute[70659]:           <pages unit='KiB' size='4'>2063775</pages>
Jul 25 16:41:44 user nova-compute[70659]:           <pages unit='KiB' size='2048'>0</pages>
Jul 25 16:41:44 user nova-compute[70659]:           <distances>
Jul 25 16:41:44 user nova-compute[70659]:             <sibling id='0' value='20'/>
Jul 25 16:41:44 user nova-compute[70659]:             <sibling id='1' value='10'/>
Jul 25 16:41:44 user nova-compute[70659]:           </distances>
Jul 25 16:41:44 user nova-compute[70659]:           <cpus num='6'>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 25 16:41:44 user nova-compute[70659]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 25 16:41:44 user nova-compute[70659]:           </cpus>
Jul 25 16:41:44 user nova-compute[70659]:         </cell>
Jul 25 16:41:44 user nova-compute[70659]:       </cells>
Jul 25 16:41:44 user nova-compute[70659]:     </topology>
Jul 25 16:41:44 user nova-compute[70659]:     <cache>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 25 16:41:44 user nova-compute[70659]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 25 16:41:44 user nova-compute[70659]:     </cache>
Jul 25 16:41:44 user nova-compute[70659]:     <secmodel>
Jul 25 16:41:44 user nova-compute[70659]:       <model>apparmor</model>
Jul 25 16:41:44 user nova-compute[70659]:       <doi>0</doi>
Jul 25 16:41:44 user nova-compute[70659]:     </secmodel>
Jul 25 16:41:44 user nova-compute[70659]:     <secmodel>
Jul 25 16:41:44 user nova-compute[70659]:       <model>dac</model>
Jul 25 16:41:44 user nova-compute[70659]:       <doi>0</doi>
Jul 25 16:41:44 user nova-compute[70659]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 25 16:41:44 user nova-compute[70659]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 25 16:41:44 user nova-compute[70659]:     </secmodel>
Jul 25 16:41:44 user nova-compute[70659]:   </host>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='alpha'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>clipper</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='armv6l'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>integratorcp</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>borzoi</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>spitz</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>nuri</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>musca-b1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>versatileab</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>kzm</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>musca-a</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>smdkc210</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sx1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>z2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>tosa</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>sabrelite</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>realview-eb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>n810</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>n800</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>versatilepb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>terrier</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mainstone</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>midway</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>musicpal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>microbit</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>cubieboard</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>verdex</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>netduino2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>raspi2b</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>cheetah</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>highbank</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>akita</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>connex</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>collie</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>raspi0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='armv7l'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>integratorcp</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>borzoi</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>spitz</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>nuri</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>musca-b1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>versatileab</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>kzm</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>musca-a</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>smdkc210</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sx1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>z2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>tosa</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>sabrelite</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>realview-eb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>n810</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>n800</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>versatilepb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>terrier</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mainstone</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>midway</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>musicpal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>microbit</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>cubieboard</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>verdex</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>netduino2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>raspi2b</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>cheetah</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>highbank</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>akita</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>connex</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>collie</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>raspi0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='aarch64'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>integratorcp</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>borzoi</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>spitz</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>nuri</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>musca-b1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>versatileab</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>kzm</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>musca-a</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>smdkc210</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sx1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>z2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>tosa</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>sabrelite</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>realview-eb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>n810</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>n800</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>versatilepb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>terrier</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mainstone</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>midway</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>musicpal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>microbit</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>cubieboard</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>verdex</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>netduino2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>raspi3b</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>raspi2b</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>cheetah</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>highbank</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>akita</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>connex</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>collie</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>raspi0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <acpi default='on' toggle='yes'/>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='cris'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='i686'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>x-remote</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>isapc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>microvm</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='kvm'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <pae/>
Jul 25 16:41:44 user nova-compute[70659]:       <nonpae/>
Jul 25 16:41:44 user nova-compute[70659]:       <acpi default='on' toggle='yes'/>
Jul 25 16:41:44 user nova-compute[70659]:       <apic default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='m68k'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>an5206</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>q800</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>next-cube</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='microblaze'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='microblazeel'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='mips'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='16'>malta</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='mipsel'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='16'>malta</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='mips64'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='16'>malta</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>pica61</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>magnum</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='mips64el'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='16'>malta</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>pica61</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>magnum</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='16'>boston</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='ppc'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>g3beige</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mac99</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>ppce500</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>pegasos2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sam460ex</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>bamboo</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>40p</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>ref405ep</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>taihu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='ppc64'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2048'>powernv9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>taihu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2048'>powernv10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>ppce500</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>40p</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>pegasos2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>bamboo</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>g3beige</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mac99</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sam460ex</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>ref405ep</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2048'>powernv8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='ppc64le'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2048'>powernv9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>taihu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2048'>powernv10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>ppce500</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>40p</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>pegasos2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>bamboo</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>g3beige</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>mac99</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sam460ex</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>ref405ep</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2048'>powernv8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='riscv32'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='8'>spike</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>opentitan</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='5'>sifive_u</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sifive_e</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='8'>virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='riscv64'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='8'>spike</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='5'>sifive_u</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>shakti_c</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sifive_e</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='8'>virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='s390x'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='sh4'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>shix</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>r2d</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='sh4eb'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>shix</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>r2d</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='sparc'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>SS-5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>SS-20</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>LX</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>SS-4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>SS-10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>Voyager</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='sparc64'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sun4u</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>niagara</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>sun4v</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='x86_64'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>64</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>x-remote</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='1'>isapc</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>microvm</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='kvm'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <acpi default='on' toggle='yes'/>
Jul 25 16:41:44 user nova-compute[70659]:       <apic default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='xtensa'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>sim</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>kc705</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>ml605</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>lx200</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>lx60</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]:   <guest>
Jul 25 16:41:44 user nova-compute[70659]:     <os_type>hvm</os_type>
Jul 25 16:41:44 user nova-compute[70659]:     <arch name='xtensaeb'>
Jul 25 16:41:44 user nova-compute[70659]:       <wordsize>32</wordsize>
Jul 25 16:41:44 user nova-compute[70659]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='4'>sim</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>kc705</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>ml605</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>virt</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>lx200</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>lx60</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 25 16:41:44 user nova-compute[70659]:       <domain type='qemu'/>
Jul 25 16:41:44 user nova-compute[70659]:     </arch>
Jul 25 16:41:44 user nova-compute[70659]:     <features>
Jul 25 16:41:44 user nova-compute[70659]:       <cpuselection/>
Jul 25 16:41:44 user nova-compute[70659]:       <deviceboot/>
Jul 25 16:41:44 user nova-compute[70659]:       <disksnapshot default='on' toggle='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     </features>
Jul 25 16:41:44 user nova-compute[70659]:   </guest>
Jul 25 16:41:44 user nova-compute[70659]: </capabilities>
Jul 25 16:41:44 user nova-compute[70659]: 
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 25 16:41:44 user nova-compute[70659]: <domainCapabilities>
Jul 25 16:41:44 user nova-compute[70659]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 16:41:44 user nova-compute[70659]:   <domain>kvm</domain>
Jul 25 16:41:44 user nova-compute[70659]:   <machine>pc-q35-jammy</machine>
Jul 25 16:41:44 user nova-compute[70659]:   <arch>i686</arch>
Jul 25 16:41:44 user nova-compute[70659]:   <vcpu max='288'/>
Jul 25 16:41:44 user nova-compute[70659]:   <iothreads supported='yes'/>
Jul 25 16:41:44 user nova-compute[70659]:   <os supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:     <enum name='firmware'/>
Jul 25 16:41:44 user nova-compute[70659]:     <loader supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 16:41:44 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 16:41:44 user nova-compute[70659]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 16:41:44 user nova-compute[70659]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 16:41:44 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>rom</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>pflash</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='readonly'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='secure'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:     </loader>
Jul 25 16:41:44 user nova-compute[70659]:   </os>
Jul 25 16:41:44 user nova-compute[70659]:   <cpu>
Jul 25 16:41:44 user nova-compute[70659]:     <mode name='host-passthrough' supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='hostPassthroughMigratable'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:     </mode>
Jul 25 16:41:44 user nova-compute[70659]:     <mode name='maximum' supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='maximumMigratable'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:     </mode>
Jul 25 16:41:44 user nova-compute[70659]:     <mode name='host-model' supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <vendor>Intel</vendor>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='ss'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='vmx'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='pcid'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='hypervisor'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='arat'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='umip'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='md-clear'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='stibp'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='ssbd'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='ibpb'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='ibrs'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='amd-stibp'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='disable' name='erms'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 16:41:44 user nova-compute[70659]:       <feature policy='disable' name='lm'/>
Jul 25 16:41:44 user nova-compute[70659]:     </mode>
Jul 25 16:41:44 user nova-compute[70659]:     <mode name='custom' supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>qemu64</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='yes'>qemu32</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>phenom</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='yes'>pentium3</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='yes'>pentium2</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='yes'>pentium</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>n270</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>kvm64</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='yes'>kvm32</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='yes'>coreduo</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>core2duo</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>athlon</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Westmere</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Snowridge</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Skylake-Server</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Skylake-Client</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>SandyBridge</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Penryn</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Opteron_G5</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Opteron_G4</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Opteron_G3</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Opteron_G2</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Opteron_G1</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Nehalem</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>IvyBridge</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Icelake-Server</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Haswell</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>EPYC-Rome</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>EPYC-Milan</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>EPYC</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Dhyana</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Cooperlake</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Conroe</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='no'>Broadwell</model>
Jul 25 16:41:44 user nova-compute[70659]:       <model usable='yes'>486</model>
Jul 25 16:41:44 user nova-compute[70659]:     </mode>
Jul 25 16:41:44 user nova-compute[70659]:   </cpu>
Jul 25 16:41:44 user nova-compute[70659]:   <memoryBacking supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:     <enum name='sourceType'>
Jul 25 16:41:44 user nova-compute[70659]:       <value>file</value>
Jul 25 16:41:44 user nova-compute[70659]:       <value>anonymous</value>
Jul 25 16:41:44 user nova-compute[70659]:       <value>memfd</value>
Jul 25 16:41:44 user nova-compute[70659]:     </enum>
Jul 25 16:41:44 user nova-compute[70659]:   </memoryBacking>
Jul 25 16:41:44 user nova-compute[70659]:   <devices>
Jul 25 16:41:44 user nova-compute[70659]:     <disk supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='diskDevice'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>disk</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>cdrom</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>floppy</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>lun</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='bus'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>fdc</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>sata</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:     </disk>
Jul 25 16:41:44 user nova-compute[70659]:     <graphics supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>sdl</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>vnc</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>spice</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>egl-headless</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:     </graphics>
Jul 25 16:41:44 user nova-compute[70659]:     <video supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='modelType'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>vga</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>cirrus</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>vmvga</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>qxl</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>none</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>bochs</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>ramfb</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:     </video>
Jul 25 16:41:44 user nova-compute[70659]:     <hostdev supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='mode'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>subsystem</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='startupPolicy'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>default</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>mandatory</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>requisite</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>optional</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='subsysType'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>pci</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='capsType'/>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='pciBackend'/>
Jul 25 16:41:44 user nova-compute[70659]:     </hostdev>
Jul 25 16:41:44 user nova-compute[70659]:     <rng supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>random</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>egd</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>builtin</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:     </rng>
Jul 25 16:41:44 user nova-compute[70659]:     <filesystem supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='driverType'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>path</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>handle</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>virtiofs</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:     </filesystem>
Jul 25 16:41:44 user nova-compute[70659]:     <tpm supported='yes'>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>tpm-tis</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>tpm-crb</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:44 user nova-compute[70659]:         <value>passthrough</value>
Jul 25 16:41:44 user nova-compute[70659]:         <value>emulator</value>
Jul 25 16:41:44 user nova-compute[70659]:       </enum>
Jul 25 16:41:44 user nova-compute[70659]:     </tpm>
Jul 25 16:41:44 user nova-compute[70659]:   </devices>
Jul 25 16:41:44 user nova-compute[70659]:   <features>
Jul 25 16:41:44 user nova-compute[70659]:     <gic supported='no'/>
Jul 25 16:41:44 user nova-compute[70659]:     <vmcoreinfo supported='yes'/>
Jul 25 16:41:44 user nova-compute[70659]:     <genid supported='yes'/>
Jul 25 16:41:44 user nova-compute[70659]:     <backingStoreInput supported='yes'/>
Jul 25 16:41:44 user nova-compute[70659]:     <backup supported='yes'/>
Jul 25 16:41:44 user nova-compute[70659]:     <sev supported='no'/>
Jul 25 16:41:44 user nova-compute[70659]:   </features>
Jul 25 16:41:44 user nova-compute[70659]: </domainCapabilities>
Jul 25 16:41:44 user nova-compute[70659]:  {{(pid=70659) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 25 16:41:45 user nova-compute[70659]: <domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 16:41:45 user nova-compute[70659]:   <domain>kvm</domain>
Jul 25 16:41:45 user nova-compute[70659]:   <machine>pc-i440fx-jammy</machine>
Jul 25 16:41:45 user nova-compute[70659]:   <arch>i686</arch>
Jul 25 16:41:45 user nova-compute[70659]:   <vcpu max='255'/>
Jul 25 16:41:45 user nova-compute[70659]:   <iothreads supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:   <os supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='firmware'/>
Jul 25 16:41:45 user nova-compute[70659]:     <loader supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>rom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pflash</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='readonly'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='secure'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </loader>
Jul 25 16:41:45 user nova-compute[70659]:   </os>
Jul 25 16:41:45 user nova-compute[70659]:   <cpu>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-passthrough' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='hostPassthroughMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='maximum' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='maximumMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-model' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <vendor>Intel</vendor>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ss'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='vmx'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pcid'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='hypervisor'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arat'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='umip'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='md-clear'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibpb'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibrs'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='erms'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='lm'/>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='custom' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>qemu64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>qemu32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>phenom</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>n270</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>kvm64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>coreduo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>core2duo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>athlon</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Westmere</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Snowridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Penryn</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G5</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G4</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G1</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Nehalem</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Rome</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Milan</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Dhyana</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cooperlake</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Conroe</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>486</model>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:   </cpu>
Jul 25 16:41:45 user nova-compute[70659]:   <memoryBacking supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='sourceType'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>file</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>anonymous</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>memfd</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:   </memoryBacking>
Jul 25 16:41:45 user nova-compute[70659]:   <devices>
Jul 25 16:41:45 user nova-compute[70659]:     <disk supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='diskDevice'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>disk</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cdrom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>floppy</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>lun</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='bus'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ide</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>fdc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sata</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </disk>
Jul 25 16:41:45 user nova-compute[70659]:     <graphics supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sdl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vnc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>spice</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egl-headless</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </graphics>
Jul 25 16:41:45 user nova-compute[70659]:     <video supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='modelType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cirrus</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vmvga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>qxl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>none</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>bochs</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ramfb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </video>
Jul 25 16:41:45 user nova-compute[70659]:     <hostdev supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='mode'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>subsystem</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='startupPolicy'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>default</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>mandatory</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>requisite</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>optional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='subsysType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pci</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='capsType'/>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='pciBackend'/>
Jul 25 16:41:45 user nova-compute[70659]:     </hostdev>
Jul 25 16:41:45 user nova-compute[70659]:     <rng supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>random</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egd</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>builtin</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </rng>
Jul 25 16:41:45 user nova-compute[70659]:     <filesystem supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='driverType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>path</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>handle</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtiofs</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </filesystem>
Jul 25 16:41:45 user nova-compute[70659]:     <tpm supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-tis</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-crb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>passthrough</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>emulator</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </tpm>
Jul 25 16:41:45 user nova-compute[70659]:   </devices>
Jul 25 16:41:45 user nova-compute[70659]:   <features>
Jul 25 16:41:45 user nova-compute[70659]:     <gic supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:     <vmcoreinfo supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <genid supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backingStoreInput supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backup supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <sev supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:   </features>
Jul 25 16:41:45 user nova-compute[70659]: </domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:  {{(pid=70659) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 25 16:41:45 user nova-compute[70659]: <domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 16:41:45 user nova-compute[70659]:   <domain>kvm</domain>
Jul 25 16:41:45 user nova-compute[70659]:   <machine>pc-i440fx-6.2</machine>
Jul 25 16:41:45 user nova-compute[70659]:   <arch>i686</arch>
Jul 25 16:41:45 user nova-compute[70659]:   <vcpu max='255'/>
Jul 25 16:41:45 user nova-compute[70659]:   <iothreads supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:   <os supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='firmware'/>
Jul 25 16:41:45 user nova-compute[70659]:     <loader supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>rom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pflash</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='readonly'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='secure'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </loader>
Jul 25 16:41:45 user nova-compute[70659]:   </os>
Jul 25 16:41:45 user nova-compute[70659]:   <cpu>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-passthrough' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='hostPassthroughMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='maximum' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='maximumMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-model' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <vendor>Intel</vendor>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ss'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='vmx'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pcid'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='hypervisor'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arat'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='umip'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='md-clear'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibpb'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibrs'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='erms'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='lm'/>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='custom' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>qemu64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>qemu32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>phenom</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>n270</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>kvm64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>coreduo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>core2duo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>athlon</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Westmere</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Snowridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Penryn</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G5</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G4</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G1</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Nehalem</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Rome</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Milan</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Dhyana</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cooperlake</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Conroe</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>486</model>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:   </cpu>
Jul 25 16:41:45 user nova-compute[70659]:   <memoryBacking supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='sourceType'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>file</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>anonymous</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>memfd</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:   </memoryBacking>
Jul 25 16:41:45 user nova-compute[70659]:   <devices>
Jul 25 16:41:45 user nova-compute[70659]:     <disk supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='diskDevice'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>disk</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cdrom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>floppy</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>lun</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='bus'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ide</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>fdc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sata</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </disk>
Jul 25 16:41:45 user nova-compute[70659]:     <graphics supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sdl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vnc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>spice</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egl-headless</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </graphics>
Jul 25 16:41:45 user nova-compute[70659]:     <video supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='modelType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cirrus</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vmvga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>qxl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>none</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>bochs</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ramfb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </video>
Jul 25 16:41:45 user nova-compute[70659]:     <hostdev supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='mode'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>subsystem</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='startupPolicy'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>default</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>mandatory</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>requisite</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>optional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='subsysType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pci</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='capsType'/>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='pciBackend'/>
Jul 25 16:41:45 user nova-compute[70659]:     </hostdev>
Jul 25 16:41:45 user nova-compute[70659]:     <rng supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>random</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egd</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>builtin</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </rng>
Jul 25 16:41:45 user nova-compute[70659]:     <filesystem supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='driverType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>path</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>handle</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtiofs</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </filesystem>
Jul 25 16:41:45 user nova-compute[70659]:     <tpm supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-tis</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-crb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>passthrough</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>emulator</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </tpm>
Jul 25 16:41:45 user nova-compute[70659]:   </devices>
Jul 25 16:41:45 user nova-compute[70659]:   <features>
Jul 25 16:41:45 user nova-compute[70659]:     <gic supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:     <vmcoreinfo supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <genid supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backingStoreInput supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backup supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <sev supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:   </features>
Jul 25 16:41:45 user nova-compute[70659]: </domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:  {{(pid=70659) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 25 16:41:45 user nova-compute[70659]: <domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 16:41:45 user nova-compute[70659]:   <domain>kvm</domain>
Jul 25 16:41:45 user nova-compute[70659]:   <machine>pc-q35-6.2</machine>
Jul 25 16:41:45 user nova-compute[70659]:   <arch>i686</arch>
Jul 25 16:41:45 user nova-compute[70659]:   <vcpu max='288'/>
Jul 25 16:41:45 user nova-compute[70659]:   <iothreads supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:   <os supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='firmware'/>
Jul 25 16:41:45 user nova-compute[70659]:     <loader supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>rom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pflash</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='readonly'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='secure'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </loader>
Jul 25 16:41:45 user nova-compute[70659]:   </os>
Jul 25 16:41:45 user nova-compute[70659]:   <cpu>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-passthrough' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='hostPassthroughMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='maximum' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='maximumMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-model' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <vendor>Intel</vendor>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ss'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='vmx'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pcid'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='hypervisor'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arat'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='umip'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='md-clear'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibpb'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibrs'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='erms'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='lm'/>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='custom' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>qemu64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>qemu32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>phenom</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>n270</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>kvm64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>coreduo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>core2duo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>athlon</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Westmere</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Snowridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Penryn</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G5</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G4</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G1</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Nehalem</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Rome</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Milan</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Dhyana</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cooperlake</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Conroe</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>486</model>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:   </cpu>
Jul 25 16:41:45 user nova-compute[70659]:   <memoryBacking supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='sourceType'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>file</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>anonymous</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>memfd</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:   </memoryBacking>
Jul 25 16:41:45 user nova-compute[70659]:   <devices>
Jul 25 16:41:45 user nova-compute[70659]:     <disk supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='diskDevice'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>disk</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cdrom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>floppy</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>lun</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='bus'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>fdc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sata</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </disk>
Jul 25 16:41:45 user nova-compute[70659]:     <graphics supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sdl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vnc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>spice</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egl-headless</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </graphics>
Jul 25 16:41:45 user nova-compute[70659]:     <video supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='modelType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cirrus</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vmvga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>qxl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>none</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>bochs</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ramfb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </video>
Jul 25 16:41:45 user nova-compute[70659]:     <hostdev supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='mode'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>subsystem</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='startupPolicy'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>default</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>mandatory</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>requisite</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>optional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='subsysType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pci</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='capsType'/>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='pciBackend'/>
Jul 25 16:41:45 user nova-compute[70659]:     </hostdev>
Jul 25 16:41:45 user nova-compute[70659]:     <rng supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>random</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egd</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>builtin</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </rng>
Jul 25 16:41:45 user nova-compute[70659]:     <filesystem supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='driverType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>path</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>handle</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtiofs</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </filesystem>
Jul 25 16:41:45 user nova-compute[70659]:     <tpm supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-tis</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-crb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>passthrough</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>emulator</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </tpm>
Jul 25 16:41:45 user nova-compute[70659]:   </devices>
Jul 25 16:41:45 user nova-compute[70659]:   <features>
Jul 25 16:41:45 user nova-compute[70659]:     <gic supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:     <vmcoreinfo supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <genid supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backingStoreInput supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backup supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <sev supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:   </features>
Jul 25 16:41:45 user nova-compute[70659]: </domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:  {{(pid=70659) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 25 16:41:45 user nova-compute[70659]: <domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 16:41:45 user nova-compute[70659]:   <domain>kvm</domain>
Jul 25 16:41:45 user nova-compute[70659]:   <machine>pc-q35-jammy</machine>
Jul 25 16:41:45 user nova-compute[70659]:   <arch>x86_64</arch>
Jul 25 16:41:45 user nova-compute[70659]:   <vcpu max='288'/>
Jul 25 16:41:45 user nova-compute[70659]:   <iothreads supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:   <os supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='firmware'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>efi</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:     <loader supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>rom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pflash</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='readonly'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='secure'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </loader>
Jul 25 16:41:45 user nova-compute[70659]:   </os>
Jul 25 16:41:45 user nova-compute[70659]:   <cpu>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-passthrough' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='hostPassthroughMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='maximum' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='maximumMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-model' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <vendor>Intel</vendor>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ss'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='vmx'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pcid'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='hypervisor'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arat'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='umip'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='md-clear'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='invtsc'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibpb'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibrs'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='rsba'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='erms'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='custom' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>qemu64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>qemu32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>phenom</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>n270</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>coreduo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>core2duo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>athlon</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Westmere</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Snowridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Penryn</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G5</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G4</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Opteron_G1</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Nehalem</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Rome</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Milan</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Dhyana</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cooperlake</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Conroe</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>486</model>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:   </cpu>
Jul 25 16:41:45 user nova-compute[70659]:   <memoryBacking supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='sourceType'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>file</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>anonymous</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>memfd</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:   </memoryBacking>
Jul 25 16:41:45 user nova-compute[70659]:   <devices>
Jul 25 16:41:45 user nova-compute[70659]:     <disk supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='diskDevice'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>disk</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cdrom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>floppy</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>lun</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='bus'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>fdc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sata</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </disk>
Jul 25 16:41:45 user nova-compute[70659]:     <graphics supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sdl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vnc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>spice</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egl-headless</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </graphics>
Jul 25 16:41:45 user nova-compute[70659]:     <video supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='modelType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cirrus</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vmvga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>qxl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>none</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>bochs</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ramfb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </video>
Jul 25 16:41:45 user nova-compute[70659]:     <hostdev supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='mode'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>subsystem</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='startupPolicy'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>default</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>mandatory</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>requisite</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>optional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='subsysType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pci</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='capsType'/>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='pciBackend'/>
Jul 25 16:41:45 user nova-compute[70659]:     </hostdev>
Jul 25 16:41:45 user nova-compute[70659]:     <rng supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>random</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egd</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>builtin</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </rng>
Jul 25 16:41:45 user nova-compute[70659]:     <filesystem supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='driverType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>path</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>handle</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtiofs</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </filesystem>
Jul 25 16:41:45 user nova-compute[70659]:     <tpm supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-tis</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-crb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>passthrough</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>emulator</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </tpm>
Jul 25 16:41:45 user nova-compute[70659]:   </devices>
Jul 25 16:41:45 user nova-compute[70659]:   <features>
Jul 25 16:41:45 user nova-compute[70659]:     <gic supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:     <vmcoreinfo supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <genid supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backingStoreInput supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backup supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <sev supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:   </features>
Jul 25 16:41:45 user nova-compute[70659]: </domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:  {{(pid=70659) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 25 16:41:45 user nova-compute[70659]: <domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 16:41:45 user nova-compute[70659]:   <domain>kvm</domain>
Jul 25 16:41:45 user nova-compute[70659]:   <machine>pc-i440fx-jammy</machine>
Jul 25 16:41:45 user nova-compute[70659]:   <arch>x86_64</arch>
Jul 25 16:41:45 user nova-compute[70659]:   <vcpu max='255'/>
Jul 25 16:41:45 user nova-compute[70659]:   <iothreads supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:   <os supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='firmware'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>efi</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:     <loader supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>rom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pflash</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='readonly'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='secure'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </loader>
Jul 25 16:41:45 user nova-compute[70659]:   </os>
Jul 25 16:41:45 user nova-compute[70659]:   <cpu>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-passthrough' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='hostPassthroughMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='maximum' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='maximumMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-model' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <vendor>Intel</vendor>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ss'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='vmx'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pcid'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='hypervisor'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arat'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='umip'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='md-clear'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='invtsc'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibpb'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibrs'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='rsba'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='erms'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='custom' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>qemu64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>qemu32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>phenom</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>n270</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>coreduo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>core2duo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>athlon</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Westmere</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Snowridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Penryn</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G5</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G4</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Opteron_G1</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Nehalem</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Rome</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Milan</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Dhyana</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cooperlake</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Conroe</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>486</model>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:   </cpu>
Jul 25 16:41:45 user nova-compute[70659]:   <memoryBacking supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='sourceType'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>file</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>anonymous</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>memfd</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:   </memoryBacking>
Jul 25 16:41:45 user nova-compute[70659]:   <devices>
Jul 25 16:41:45 user nova-compute[70659]:     <disk supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='diskDevice'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>disk</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cdrom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>floppy</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>lun</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='bus'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ide</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>fdc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sata</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </disk>
Jul 25 16:41:45 user nova-compute[70659]:     <graphics supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sdl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vnc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>spice</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egl-headless</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </graphics>
Jul 25 16:41:45 user nova-compute[70659]:     <video supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='modelType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cirrus</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vmvga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>qxl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>none</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>bochs</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ramfb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </video>
Jul 25 16:41:45 user nova-compute[70659]:     <hostdev supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='mode'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>subsystem</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='startupPolicy'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>default</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>mandatory</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>requisite</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>optional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='subsysType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pci</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='capsType'/>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='pciBackend'/>
Jul 25 16:41:45 user nova-compute[70659]:     </hostdev>
Jul 25 16:41:45 user nova-compute[70659]:     <rng supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>random</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egd</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>builtin</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </rng>
Jul 25 16:41:45 user nova-compute[70659]:     <filesystem supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='driverType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>path</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>handle</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtiofs</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </filesystem>
Jul 25 16:41:45 user nova-compute[70659]:     <tpm supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-tis</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-crb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>passthrough</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>emulator</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </tpm>
Jul 25 16:41:45 user nova-compute[70659]:   </devices>
Jul 25 16:41:45 user nova-compute[70659]:   <features>
Jul 25 16:41:45 user nova-compute[70659]:     <gic supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:     <vmcoreinfo supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <genid supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backingStoreInput supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backup supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <sev supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:   </features>
Jul 25 16:41:45 user nova-compute[70659]: </domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:  {{(pid=70659) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 25 16:41:45 user nova-compute[70659]: <domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 16:41:45 user nova-compute[70659]:   <domain>kvm</domain>
Jul 25 16:41:45 user nova-compute[70659]:   <machine>pc-i440fx-6.2</machine>
Jul 25 16:41:45 user nova-compute[70659]:   <arch>x86_64</arch>
Jul 25 16:41:45 user nova-compute[70659]:   <vcpu max='255'/>
Jul 25 16:41:45 user nova-compute[70659]:   <iothreads supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:   <os supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='firmware'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>efi</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:     <loader supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>rom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pflash</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='readonly'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='secure'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </loader>
Jul 25 16:41:45 user nova-compute[70659]:   </os>
Jul 25 16:41:45 user nova-compute[70659]:   <cpu>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-passthrough' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='hostPassthroughMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='maximum' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='maximumMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-model' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <vendor>Intel</vendor>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ss'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='vmx'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pcid'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='hypervisor'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arat'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='umip'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='md-clear'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='invtsc'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibpb'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibrs'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='rsba'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='erms'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='custom' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>qemu64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>qemu32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>phenom</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>n270</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>coreduo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>core2duo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>athlon</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Westmere</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Snowridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Penryn</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G5</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G4</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Opteron_G1</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Nehalem</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Rome</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Milan</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Dhyana</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cooperlake</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Conroe</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>486</model>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:   </cpu>
Jul 25 16:41:45 user nova-compute[70659]:   <memoryBacking supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='sourceType'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>file</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>anonymous</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>memfd</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:   </memoryBacking>
Jul 25 16:41:45 user nova-compute[70659]:   <devices>
Jul 25 16:41:45 user nova-compute[70659]:     <disk supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='diskDevice'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>disk</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cdrom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>floppy</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>lun</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='bus'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ide</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>fdc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sata</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </disk>
Jul 25 16:41:45 user nova-compute[70659]:     <graphics supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sdl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vnc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>spice</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egl-headless</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </graphics>
Jul 25 16:41:45 user nova-compute[70659]:     <video supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='modelType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cirrus</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vmvga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>qxl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>none</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>bochs</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ramfb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </video>
Jul 25 16:41:45 user nova-compute[70659]:     <hostdev supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='mode'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>subsystem</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='startupPolicy'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>default</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>mandatory</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>requisite</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>optional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='subsysType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pci</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='capsType'/>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='pciBackend'/>
Jul 25 16:41:45 user nova-compute[70659]:     </hostdev>
Jul 25 16:41:45 user nova-compute[70659]:     <rng supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>random</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egd</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>builtin</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </rng>
Jul 25 16:41:45 user nova-compute[70659]:     <filesystem supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='driverType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>path</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>handle</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtiofs</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </filesystem>
Jul 25 16:41:45 user nova-compute[70659]:     <tpm supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-tis</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-crb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>passthrough</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>emulator</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </tpm>
Jul 25 16:41:45 user nova-compute[70659]:   </devices>
Jul 25 16:41:45 user nova-compute[70659]:   <features>
Jul 25 16:41:45 user nova-compute[70659]:     <gic supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:     <vmcoreinfo supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <genid supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backingStoreInput supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backup supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <sev supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:   </features>
Jul 25 16:41:45 user nova-compute[70659]: </domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:  {{(pid=70659) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 25 16:41:45 user nova-compute[70659]: <domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 16:41:45 user nova-compute[70659]:   <domain>kvm</domain>
Jul 25 16:41:45 user nova-compute[70659]:   <machine>pc-q35-6.2</machine>
Jul 25 16:41:45 user nova-compute[70659]:   <arch>x86_64</arch>
Jul 25 16:41:45 user nova-compute[70659]:   <vcpu max='288'/>
Jul 25 16:41:45 user nova-compute[70659]:   <iothreads supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:   <os supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='firmware'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>efi</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:     <loader supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>rom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pflash</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='readonly'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='secure'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>yes</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>no</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </loader>
Jul 25 16:41:45 user nova-compute[70659]:   </os>
Jul 25 16:41:45 user nova-compute[70659]:   <cpu>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-passthrough' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='hostPassthroughMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='maximum' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='maximumMigratable'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>on</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>off</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='host-model' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <vendor>Intel</vendor>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ss'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='vmx'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pcid'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='hypervisor'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arat'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='umip'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='md-clear'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='invtsc'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibpb'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='ibrs'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-stibp'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='rsba'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='erms'/>
Jul 25 16:41:45 user nova-compute[70659]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:     <mode name='custom' supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>qemu64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>qemu32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>phenom</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>pentium</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>n270</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm64</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>kvm32</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>coreduo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>core2duo</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>athlon</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Westmere</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Snowridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Skylake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>SandyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Penryn</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G5</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G4</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G3</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Opteron_G2</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Opteron_G1</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Nehalem</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>IvyBridge</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Icelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Haswell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Rome</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-Milan</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>EPYC</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Dhyana</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cooperlake</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>Conroe</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='no'>Broadwell</model>
Jul 25 16:41:45 user nova-compute[70659]:       <model usable='yes'>486</model>
Jul 25 16:41:45 user nova-compute[70659]:     </mode>
Jul 25 16:41:45 user nova-compute[70659]:   </cpu>
Jul 25 16:41:45 user nova-compute[70659]:   <memoryBacking supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:     <enum name='sourceType'>
Jul 25 16:41:45 user nova-compute[70659]:       <value>file</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>anonymous</value>
Jul 25 16:41:45 user nova-compute[70659]:       <value>memfd</value>
Jul 25 16:41:45 user nova-compute[70659]:     </enum>
Jul 25 16:41:45 user nova-compute[70659]:   </memoryBacking>
Jul 25 16:41:45 user nova-compute[70659]:   <devices>
Jul 25 16:41:45 user nova-compute[70659]:     <disk supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='diskDevice'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>disk</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cdrom</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>floppy</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>lun</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='bus'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>fdc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sata</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </disk>
Jul 25 16:41:45 user nova-compute[70659]:     <graphics supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='type'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>sdl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vnc</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>spice</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egl-headless</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </graphics>
Jul 25 16:41:45 user nova-compute[70659]:     <video supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='modelType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>cirrus</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>vmvga</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>qxl</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>none</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>bochs</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>ramfb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </video>
Jul 25 16:41:45 user nova-compute[70659]:     <hostdev supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='mode'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>subsystem</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='startupPolicy'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>default</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>mandatory</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>requisite</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>optional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='subsysType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>usb</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>pci</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>scsi</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='capsType'/>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='pciBackend'/>
Jul 25 16:41:45 user nova-compute[70659]:     </hostdev>
Jul 25 16:41:45 user nova-compute[70659]:     <rng supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtio-non-transitional</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>random</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>egd</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>builtin</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </rng>
Jul 25 16:41:45 user nova-compute[70659]:     <filesystem supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='driverType'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>path</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>handle</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>virtiofs</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </filesystem>
Jul 25 16:41:45 user nova-compute[70659]:     <tpm supported='yes'>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='model'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-tis</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>tpm-crb</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:       <enum name='backendModel'>
Jul 25 16:41:45 user nova-compute[70659]:         <value>passthrough</value>
Jul 25 16:41:45 user nova-compute[70659]:         <value>emulator</value>
Jul 25 16:41:45 user nova-compute[70659]:       </enum>
Jul 25 16:41:45 user nova-compute[70659]:     </tpm>
Jul 25 16:41:45 user nova-compute[70659]:   </devices>
Jul 25 16:41:45 user nova-compute[70659]:   <features>
Jul 25 16:41:45 user nova-compute[70659]:     <gic supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:     <vmcoreinfo supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <genid supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backingStoreInput supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <backup supported='yes'/>
Jul 25 16:41:45 user nova-compute[70659]:     <sev supported='no'/>
Jul 25 16:41:45 user nova-compute[70659]:   </features>
Jul 25 16:41:45 user nova-compute[70659]: </domainCapabilities>
Jul 25 16:41:45 user nova-compute[70659]:  {{(pid=70659) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70659) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70659) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Checking secure boot support for host arch (x86_64) {{(pid=70659) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 25 16:41:45 user nova-compute[70659]: INFO nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Secure Boot support detected
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] cpu compare xml: <cpu match="exact">
Jul 25 16:41:45 user nova-compute[70659]:   <model>Nehalem</model>
Jul 25 16:41:45 user nova-compute[70659]: </cpu>
Jul 25 16:41:45 user nova-compute[70659]:  {{(pid=70659) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 25 16:41:45 user nova-compute[70659]: INFO nova.virt.node [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Generated node identity 9f90033f-5d23-4363-83e3-e56f7852cf56
Jul 25 16:41:45 user nova-compute[70659]: INFO nova.virt.node [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Wrote node identity 9f90033f-5d23-4363-83e3-e56f7852cf56 to /opt/stack/data/nova/compute_id
Jul 25 16:41:45 user nova-compute[70659]: WARNING nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Compute nodes ['9f90033f-5d23-4363-83e3-e56f7852cf56'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 25 16:41:45 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 25 16:41:45 user nova-compute[70659]: WARNING nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 25 16:41:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:41:45 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:41:45 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Hypervisor/Node resource view: name=user free_ram=10868MB free_disk=26.270267486572266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:41:45 user nova-compute[70659]: WARNING nova.compute.resource_tracker [None req-f46683cd-2861-421f-9369-8c99a381897a None None] No compute node record for user:9f90033f-5d23-4363-83e3-e56f7852cf56: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 9f90033f-5d23-4363-83e3-e56f7852cf56 could not be found.
Jul 25 16:41:45 user nova-compute[70659]: INFO nova.compute.resource_tracker [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Compute node record created for user:user with uuid: 9f90033f-5d23-4363-83e3-e56f7852cf56
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:41:45 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [req-57b96f2a-13a0-467f-86fb-cac16828035c] Created resource provider record via placement API for resource provider with UUID 9f90033f-5d23-4363-83e3-e56f7852cf56 and name user.
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70659) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 25 16:41:45 user nova-compute[70659]: INFO nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] kernel doesn't support AMD SEV
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:41:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Libvirt baseline CPU <cpu>
Jul 25 16:41:45 user nova-compute[70659]:   <arch>x86_64</arch>
Jul 25 16:41:45 user nova-compute[70659]:   <model>Nehalem</model>
Jul 25 16:41:45 user nova-compute[70659]:   <vendor>Intel</vendor>
Jul 25 16:41:45 user nova-compute[70659]:   <topology sockets="6" cores="1" threads="1"/>
Jul 25 16:41:45 user nova-compute[70659]: </cpu>
Jul 25 16:41:45 user nova-compute[70659]:  {{(pid=70659) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 25 16:41:46 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Updated inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 25 16:41:46 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Updating resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 generation from 0 to 1 during operation: update_inventory {{(pid=70659) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 25 16:41:46 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 16:41:46 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Updating resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 generation from 1 to 2 during operation: update_traits {{(pid=70659) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 25 16:41:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:41:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:41:46 user nova-compute[70659]: DEBUG nova.service [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Creating RPC server for service compute {{(pid=70659) start /opt/stack/nova/nova/service.py:182}}
Jul 25 16:41:46 user nova-compute[70659]: DEBUG nova.service [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Join ServiceGroup membership for this service compute {{(pid=70659) start /opt/stack/nova/nova/service.py:199}}
Jul 25 16:41:46 user nova-compute[70659]: DEBUG nova.servicegroup.drivers.db [None req-f46683cd-2861-421f-9369-8c99a381897a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70659) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 25 16:42:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:42:37 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:42:37 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=10220MB free_disk=26.174304962158203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:42:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:43:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:43:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:43:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:43:38 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:43:38 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=10197MB free_disk=26.219318389892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:43:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.096s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:43:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:43:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:43:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:44:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:44:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:44:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:44:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:44:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:44:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:44:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:44:39 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:44:39 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:44:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=10186MB free_disk=25.993358612060547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:44:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:44:40 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:45:39 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:45:39 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:45:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=9474MB free_disk=26.02440643310547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:45:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:40 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:45:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:45:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 16:45:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:45:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:45:53 user nova-compute[70659]: INFO nova.compute.claims [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Claim successful on node user
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.174s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:45:53 user nova-compute[70659]: INFO nova.compute.claims [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Claim successful on node user
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.network.neutron [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:45:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:45:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Creating image(s)
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:45:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Creating image(s)
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "/opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "/opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:54 user nova-compute[70659]: DEBUG nova.policy [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9aaa70e5cce7418b96837e30769ac6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20acc57667b418ba16f573fe81841ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:45:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261.part --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:54 user nova-compute[70659]: DEBUG nova.virt.images [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] cf818516-7014-4487-8846-a63b84aa1a5a was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 16:45:54 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 16:45:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261.part /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:54 user nova-compute[70659]: DEBUG nova.policy [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1880545cfe1a4ecf9a3d4e193bb049d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0039914ee924569ae532f388899d331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:45:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261.part /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261.converted" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.201s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:55 user nova-compute[70659]: INFO oslo.privsep.daemon [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0415xwfa/privsep.sock']
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.034s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:55 user sudo[79817]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0415xwfa/privsep.sock
Jul 25 16:45:55 user sudo[79817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:45:55 user nova-compute[70659]: INFO nova.compute.claims [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Claim successful on node user
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.network.neutron [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:45:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:45:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Creating image(s)
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG nova.policy [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9aaa70e5cce7418b96837e30769ac6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20acc57667b418ba16f573fe81841ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:45:56 user sudo[79817]: pam_unix(sudo:session): session closed for user root
Jul 25 16:45:56 user nova-compute[70659]: INFO oslo.privsep.daemon [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Spawned new privsep daemon via rootwrap
Jul 25 16:45:56 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 25 16:45:56 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 25 16:45:56 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 25 16:45:56 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79820
Jul 25 16:45:56 user nova-compute[70659]: WARNING oslo_privsep.priv_context [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] privsep daemon already running
Jul 25 16:45:56 user nova-compute[70659]: WARNING oslo_privsep.priv_context [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] privsep daemon already running
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.131s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.130s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "c9728d00-f454-4616-af0b-8cfd0f012cad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG nova.network.neutron [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Successfully created port: c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:45:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk 1073741824" returned: 0 in 0.047s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.211s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:45:57 user nova-compute[70659]: INFO nova.compute.claims [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Claim successful on node user
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk 1073741824" returned: 0 in 0.049s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.424s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Cannot resize image /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lazy-loading 'migration_context' on Instance uuid 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Ensure instance console log exists: /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.180s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.166s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk 1073741824" returned: 0 in 0.054s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Cannot resize image /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'migration_context' on Instance uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Ensure instance console log exists: /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.network.neutron [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:45:57 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Cannot resize image /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'migration_context' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Ensure instance console log exists: /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:45:57 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Creating image(s)
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "/opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "/opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:57 user nova-compute[70659]: DEBUG nova.policy [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad466988c34f4e06b5c631b9754db2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa87ca828941408ebb81eb439ebbc79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.127s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk 1073741824" returned: 0 in 0.054s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.network.neutron [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Successfully updated port: c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquired lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.network.neutron [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.network.neutron [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Cannot resize image /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.objects.instance [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'migration_context' on Instance uuid c9728d00-f454-4616-af0b-8cfd0f012cad {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Ensure instance console log exists: /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.compute.manager [req-5b730226-29da-47e9-b803-907f921a32bc req-83bcdeed-30e7-4a45-8103-695257c853d4 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-changed-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.compute.manager [req-5b730226-29da-47e9-b803-907f921a32bc req-83bcdeed-30e7-4a45-8103-695257c853d4 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Refreshing instance network info cache due to event network-changed-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5b730226-29da-47e9-b803-907f921a32bc req-83bcdeed-30e7-4a45-8103-695257c853d4 service nova] Acquiring lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:45:58 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Successfully created port: db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.network.neutron [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updating instance_info_cache with network_info: [{"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Releasing lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Instance network_info: |[{"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5b730226-29da-47e9-b803-907f921a32bc req-83bcdeed-30e7-4a45-8103-695257c853d4 service nova] Acquired lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.network.neutron [req-5b730226-29da-47e9-b803-907f921a32bc req-83bcdeed-30e7-4a45-8103-695257c853d4 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Refreshing network info cache for port c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Start _get_guest_xml network_info=[{"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:45:59 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:45:59 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1476762347',display_name='tempest-ServerRescueNegativeTestJSON-server-1476762347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1476762347',id=1,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-1l240my5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:45:54Z,user_data=None,user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=c2800889-2d2e-4660-8bc9-f1f1782587d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:c5:8a,bridge_name='br-int',has_traffic_filtering=True,id=c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f4caf2-a4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.objects.instance [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'pci_devices' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:45:59 user nova-compute[70659]:   <uuid>c2800889-2d2e-4660-8bc9-f1f1782587d3</uuid>
Jul 25 16:45:59 user nova-compute[70659]:   <name>instance-00000001</name>
Jul 25 16:45:59 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:45:59 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:45:59 user nova-compute[70659]:   <metadata>
Jul 25 16:45:59 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:45:59 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:45:59 user nova-compute[70659]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1476762347</nova:name>
Jul 25 16:45:59 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:45:59</nova:creationTime>
Jul 25 16:45:59 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:45:59 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:45:59 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:45:59 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:45:59 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:45:59 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:45:59 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:45:59 user nova-compute[70659]:       <nova:owner>
Jul 25 16:45:59 user nova-compute[70659]:         <nova:user uuid="9aaa70e5cce7418b96837e30769ac6aa">tempest-ServerRescueNegativeTestJSON-1539045365-project-member</nova:user>
Jul 25 16:45:59 user nova-compute[70659]:         <nova:project uuid="d20acc57667b418ba16f573fe81841ac">tempest-ServerRescueNegativeTestJSON-1539045365</nova:project>
Jul 25 16:45:59 user nova-compute[70659]:       </nova:owner>
Jul 25 16:45:59 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:45:59 user nova-compute[70659]:       <nova:ports>
Jul 25 16:45:59 user nova-compute[70659]:         <nova:port uuid="c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1">
Jul 25 16:45:59 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 16:45:59 user nova-compute[70659]:         </nova:port>
Jul 25 16:45:59 user nova-compute[70659]:       </nova:ports>
Jul 25 16:45:59 user nova-compute[70659]:     </nova:instance>
Jul 25 16:45:59 user nova-compute[70659]:   </metadata>
Jul 25 16:45:59 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:45:59 user nova-compute[70659]:     <system>
Jul 25 16:45:59 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:45:59 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:45:59 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:45:59 user nova-compute[70659]:       <entry name="serial">c2800889-2d2e-4660-8bc9-f1f1782587d3</entry>
Jul 25 16:45:59 user nova-compute[70659]:       <entry name="uuid">c2800889-2d2e-4660-8bc9-f1f1782587d3</entry>
Jul 25 16:45:59 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:45:59 user nova-compute[70659]:     </system>
Jul 25 16:45:59 user nova-compute[70659]:   </sysinfo>
Jul 25 16:45:59 user nova-compute[70659]:   <os>
Jul 25 16:45:59 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:45:59 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:45:59 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:45:59 user nova-compute[70659]:   </os>
Jul 25 16:45:59 user nova-compute[70659]:   <features>
Jul 25 16:45:59 user nova-compute[70659]:     <acpi/>
Jul 25 16:45:59 user nova-compute[70659]:     <apic/>
Jul 25 16:45:59 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:45:59 user nova-compute[70659]:   </features>
Jul 25 16:45:59 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:45:59 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:45:59 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:45:59 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:45:59 user nova-compute[70659]:   </clock>
Jul 25 16:45:59 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:45:59 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:45:59 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:45:59 user nova-compute[70659]:   </cpu>
Jul 25 16:45:59 user nova-compute[70659]:   <devices>
Jul 25 16:45:59 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:45:59 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:45:59 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk"/>
Jul 25 16:45:59 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:45:59 user nova-compute[70659]:     </disk>
Jul 25 16:45:59 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:45:59 user nova-compute[70659]:       <mac address="fa:16:3e:98:c5:8a"/>
Jul 25 16:45:59 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:45:59 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:45:59 user nova-compute[70659]:       <target dev="tapc6f4caf2-a4"/>
Jul 25 16:45:59 user nova-compute[70659]:     </interface>
Jul 25 16:45:59 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:45:59 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/console.log" append="off"/>
Jul 25 16:45:59 user nova-compute[70659]:     </serial>
Jul 25 16:45:59 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:45:59 user nova-compute[70659]:     <video>
Jul 25 16:45:59 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:45:59 user nova-compute[70659]:     </video>
Jul 25 16:45:59 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:45:59 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:45:59 user nova-compute[70659]:     </rng>
Jul 25 16:45:59 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:45:59 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:45:59 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:45:59 user nova-compute[70659]:     </memballoon>
Jul 25 16:45:59 user nova-compute[70659]:   </devices>
Jul 25 16:45:59 user nova-compute[70659]: </domain>
Jul 25 16:45:59 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1476762347',display_name='tempest-ServerRescueNegativeTestJSON-server-1476762347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1476762347',id=1,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-1l240my5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:45:54Z,user_data=None,user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=c2800889-2d2e-4660-8bc9-f1f1782587d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:c5:8a,bridge_name='br-int',has_traffic_filtering=True,id=c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f4caf2-a4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG os_vif [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:c5:8a,bridge_name='br-int',has_traffic_filtering=True,id=c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f4caf2-a4') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Created schema index Interface.name {{(pid=70659) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Created schema index Port.name {{(pid=70659) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Created schema index Bridge.name {{(pid=70659) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [POLLOUT] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG nova.network.neutron [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Successfully created port: 59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:45:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:45:59 user nova-compute[70659]: INFO oslo.privsep.daemon [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp1bjqz70e/privsep.sock']
Jul 25 16:45:59 user sudo[79885]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp1bjqz70e/privsep.sock
Jul 25 16:45:59 user sudo[79885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:46:00 user nova-compute[70659]: INFO nova.compute.claims [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Claim successful on node user
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-5b730226-29da-47e9-b803-907f921a32bc req-83bcdeed-30e7-4a45-8103-695257c853d4 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updated VIF entry in instance network info cache for port c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-5b730226-29da-47e9-b803-907f921a32bc req-83bcdeed-30e7-4a45-8103-695257c853d4 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updating instance_info_cache with network_info: [{"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5b730226-29da-47e9-b803-907f921a32bc req-83bcdeed-30e7-4a45-8103-695257c853d4 service nova] Releasing lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Successfully created port: f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:46:00 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:46:00 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Creating image(s)
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "/opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "/opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "/opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:00 user nova-compute[70659]: DEBUG nova.policy [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a77a77d2b1954c10ace66ba38fd9ff6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de6ba95db444b5b10d51ef16525948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk 1073741824" returned: 0 in 0.067s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Cannot resize image /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'migration_context' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Ensure instance console log exists: /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.network.neutron [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Successfully updated port: 59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:46:01 user sudo[79885]: pam_unix(sudo:session): session closed for user root
Jul 25 16:46:01 user nova-compute[70659]: INFO oslo.privsep.daemon [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Spawned new privsep daemon via rootwrap
Jul 25 16:46:01 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 25 16:46:01 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 25 16:46:01 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 25 16:46:01 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79899
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquired lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.network.neutron [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-74a767f6-25b4-45c7-8116-6536c2b463e0 req-915515ee-ffe3-4da0-90dd-463fc76cc88c service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received event network-changed-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-74a767f6-25b4-45c7-8116-6536c2b463e0 req-915515ee-ffe3-4da0-90dd-463fc76cc88c service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Refreshing instance network info cache due to event network-changed-59982e84-3ac0-4ed7-b932-9fd142d77f8a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-74a767f6-25b4-45c7-8116-6536c2b463e0 req-915515ee-ffe3-4da0-90dd-463fc76cc88c service nova] Acquiring lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.network.neutron [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:46:01 user nova-compute[70659]: INFO nova.compute.claims [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Claim successful on node user
Jul 25 16:46:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:46:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6f4caf2-a4, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6f4caf2-a4, col_values=(('external_ids', {'iface-id': 'c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:c5:8a', 'vm-uuid': 'c2800889-2d2e-4660-8bc9-f1f1782587d3'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:02 user nova-compute[70659]: INFO os_vif [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:c5:8a,bridge_name='br-int',has_traffic_filtering=True,id=c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f4caf2-a4')
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Successfully created port: 3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.network.neutron [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Updating instance_info_cache with network_info: [{"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Releasing lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Instance network_info: |[{"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-74a767f6-25b4-45c7-8116-6536c2b463e0 req-915515ee-ffe3-4da0-90dd-463fc76cc88c service nova] Acquired lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.network.neutron [req-74a767f6-25b4-45c7-8116-6536c2b463e0 req-915515ee-ffe3-4da0-90dd-463fc76cc88c service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Refreshing network info cache for port 59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Start _get_guest_xml network_info=[{"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No VIF found with MAC fa:16:3e:98:c5:8a, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:02 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:02 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1639245356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1639245356',id=4,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9W5TboWtf0hc6Hzv2eWxKxfCk+KxFbuCMcv9u2xcYbqE6AO869uvN6rqAnISctUaR6HlRbCH+L5ZFWkyQFuvY+xkmYbhIXcN3yDkQ+fFgWnpNITt3DJYkCoVIOwlofCA==',key_name='tempest-keypair-444304122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa87ca828941408ebb81eb439ebbc79e',ramdisk_id='',reservation_id='r-wunzy08x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-510925623',owner_user_name='tempest-ServerActionsV293TestJSON-510925623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad466988c34f4e06b5c631b9754db2c5',uuid=c9728d00-f454-4616-af0b-8cfd0f012cad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converting VIF {"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:69:6e,bridge_name='br-int',has_traffic_filtering=True,id=59982e84-3ac0-4ed7-b932-9fd142d77f8a,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59982e84-3a') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.objects.instance [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'pci_devices' on Instance uuid c9728d00-f454-4616-af0b-8cfd0f012cad {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:46:02 user nova-compute[70659]:   <uuid>c9728d00-f454-4616-af0b-8cfd0f012cad</uuid>
Jul 25 16:46:02 user nova-compute[70659]:   <name>instance-00000004</name>
Jul 25 16:46:02 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:46:02 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:46:02 user nova-compute[70659]:   <metadata>
Jul 25 16:46:02 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:46:02 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:46:02 user nova-compute[70659]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1639245356</nova:name>
Jul 25 16:46:02 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:46:02</nova:creationTime>
Jul 25 16:46:02 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:46:02 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:46:02 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:46:02 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:46:02 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:46:02 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:46:02 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:46:02 user nova-compute[70659]:       <nova:owner>
Jul 25 16:46:02 user nova-compute[70659]:         <nova:user uuid="ad466988c34f4e06b5c631b9754db2c5">tempest-ServerActionsV293TestJSON-510925623-project-member</nova:user>
Jul 25 16:46:02 user nova-compute[70659]:         <nova:project uuid="fa87ca828941408ebb81eb439ebbc79e">tempest-ServerActionsV293TestJSON-510925623</nova:project>
Jul 25 16:46:02 user nova-compute[70659]:       </nova:owner>
Jul 25 16:46:02 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:46:02 user nova-compute[70659]:       <nova:ports>
Jul 25 16:46:02 user nova-compute[70659]:         <nova:port uuid="59982e84-3ac0-4ed7-b932-9fd142d77f8a">
Jul 25 16:46:02 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 16:46:02 user nova-compute[70659]:         </nova:port>
Jul 25 16:46:02 user nova-compute[70659]:       </nova:ports>
Jul 25 16:46:02 user nova-compute[70659]:     </nova:instance>
Jul 25 16:46:02 user nova-compute[70659]:   </metadata>
Jul 25 16:46:02 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:46:02 user nova-compute[70659]:     <system>
Jul 25 16:46:02 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:46:02 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:46:02 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:46:02 user nova-compute[70659]:       <entry name="serial">c9728d00-f454-4616-af0b-8cfd0f012cad</entry>
Jul 25 16:46:02 user nova-compute[70659]:       <entry name="uuid">c9728d00-f454-4616-af0b-8cfd0f012cad</entry>
Jul 25 16:46:02 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:46:02 user nova-compute[70659]:     </system>
Jul 25 16:46:02 user nova-compute[70659]:   </sysinfo>
Jul 25 16:46:02 user nova-compute[70659]:   <os>
Jul 25 16:46:02 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:46:02 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:46:02 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:46:02 user nova-compute[70659]:   </os>
Jul 25 16:46:02 user nova-compute[70659]:   <features>
Jul 25 16:46:02 user nova-compute[70659]:     <acpi/>
Jul 25 16:46:02 user nova-compute[70659]:     <apic/>
Jul 25 16:46:02 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:46:02 user nova-compute[70659]:   </features>
Jul 25 16:46:02 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:46:02 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:46:02 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:46:02 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:46:02 user nova-compute[70659]:   </clock>
Jul 25 16:46:02 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:46:02 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:46:02 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:46:02 user nova-compute[70659]:   </cpu>
Jul 25 16:46:02 user nova-compute[70659]:   <devices>
Jul 25 16:46:02 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:46:02 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:46:02 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk"/>
Jul 25 16:46:02 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:46:02 user nova-compute[70659]:     </disk>
Jul 25 16:46:02 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:46:02 user nova-compute[70659]:       <mac address="fa:16:3e:7d:69:6e"/>
Jul 25 16:46:02 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:02 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:46:02 user nova-compute[70659]:       <target dev="tap59982e84-3a"/>
Jul 25 16:46:02 user nova-compute[70659]:     </interface>
Jul 25 16:46:02 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:46:02 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/console.log" append="off"/>
Jul 25 16:46:02 user nova-compute[70659]:     </serial>
Jul 25 16:46:02 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:46:02 user nova-compute[70659]:     <video>
Jul 25 16:46:02 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:02 user nova-compute[70659]:     </video>
Jul 25 16:46:02 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:46:02 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:46:02 user nova-compute[70659]:     </rng>
Jul 25 16:46:02 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:46:02 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:46:02 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:46:02 user nova-compute[70659]:     </memballoon>
Jul 25 16:46:02 user nova-compute[70659]:   </devices>
Jul 25 16:46:02 user nova-compute[70659]: </domain>
Jul 25 16:46:02 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1639245356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1639245356',id=4,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9W5TboWtf0hc6Hzv2eWxKxfCk+KxFbuCMcv9u2xcYbqE6AO869uvN6rqAnISctUaR6HlRbCH+L5ZFWkyQFuvY+xkmYbhIXcN3yDkQ+fFgWnpNITt3DJYkCoVIOwlofCA==',key_name='tempest-keypair-444304122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa87ca828941408ebb81eb439ebbc79e',ramdisk_id='',reservation_id='r-wunzy08x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-510925623',owner_user_name='tempest-ServerActionsV293TestJSON-510925623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad466988c34f4e06b5c631b9754db2c5',uuid=c9728d00-f454-4616-af0b-8cfd0f012cad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converting VIF {"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:69:6e,bridge_name='br-int',has_traffic_filtering=True,id=59982e84-3ac0-4ed7-b932-9fd142d77f8a,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59982e84-3a') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG os_vif [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:69:6e,bridge_name='br-int',has_traffic_filtering=True,id=59982e84-3ac0-4ed7-b932-9fd142d77f8a,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59982e84-3a') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59982e84-3a, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59982e84-3a, col_values=(('external_ids', {'iface-id': '59982e84-3ac0-4ed7-b932-9fd142d77f8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:69:6e', 'vm-uuid': 'c9728d00-f454-4616-af0b-8cfd0f012cad'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:02 user nova-compute[70659]: INFO os_vif [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:69:6e,bridge_name='br-int',has_traffic_filtering=True,id=59982e84-3ac0-4ed7-b932-9fd142d77f8a,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59982e84-3a')
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] No VIF found with MAC fa:16:3e:7d:69:6e, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.699s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.587s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:46:02 user nova-compute[70659]: INFO nova.compute.claims [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Claim successful on node user
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:46:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.policy [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd26fb262d7b47638bb0a0df0ea10c24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ac672b01748d191239756a58474c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:46:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Creating image(s)
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.128s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.129s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Successfully updated port: db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "refresh_cache-7c9ddadf-3e5f-462d-a39d-48078a65b2b7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquired lock "refresh_cache-7c9ddadf-3e5f-462d-a39d-48078a65b2b7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk 1073741824" returned: 0 in 0.184s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.network.neutron [req-74a767f6-25b4-45c7-8116-6536c2b463e0 req-915515ee-ffe3-4da0-90dd-463fc76cc88c service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Updated VIF entry in instance network info cache for port 59982e84-3ac0-4ed7-b932-9fd142d77f8a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.network.neutron [req-74a767f6-25b4-45c7-8116-6536c2b463e0 req-915515ee-ffe3-4da0-90dd-463fc76cc88c service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Updating instance_info_cache with network_info: [{"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-74a767f6-25b4-45c7-8116-6536c2b463e0 req-915515ee-ffe3-4da0-90dd-463fc76cc88c service nova] Releasing lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.policy [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ebfb3f4c65f4e16be5234a8a4e99e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb25024c830544d682f76d9dc10171e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:46:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Creating image(s)
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "/opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "/opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "/opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-71179479-8338-48a4-9f3c-9a1493cb3b2f req-f9c58d96-8d7a-4f3c-bde2-1a3e2b28f0bb service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received event network-changed-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-71179479-8338-48a4-9f3c-9a1493cb3b2f req-f9c58d96-8d7a-4f3c-bde2-1a3e2b28f0bb service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Refreshing instance network info cache due to event network-changed-db56f158-81c9-4a49-a2b7-9849362b8620. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-71179479-8338-48a4-9f3c-9a1493cb3b2f req-f9c58d96-8d7a-4f3c-bde2-1a3e2b28f0bb service nova] Acquiring lock "refresh_cache-7c9ddadf-3e5f-462d-a39d-48078a65b2b7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Cannot resize image /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'migration_context' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Ensure instance console log exists: /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk 1073741824" returned: 0 in 0.046s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.130s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:46:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Cannot resize image /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'migration_context' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Ensure instance console log exists: /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Successfully updated port: f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquired lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Successfully updated port: 3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquired lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Updating instance_info_cache with network_info: [{"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Releasing lock "refresh_cache-7c9ddadf-3e5f-462d-a39d-48078a65b2b7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Instance network_info: |[{"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-7418c97b-ac5b-4d79-ab8c-70595039b2a6 req-6fd98fbb-724b-46b0-8250-1f151c4b57e1 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-changed-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-7418c97b-ac5b-4d79-ab8c-70595039b2a6 req-6fd98fbb-724b-46b0-8250-1f151c4b57e1 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Refreshing instance network info cache due to event network-changed-3c7f2734-73c4-4648-a080-0ea25238dad8. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7418c97b-ac5b-4d79-ab8c-70595039b2a6 req-6fd98fbb-724b-46b0-8250-1f151c4b57e1 service nova] Acquiring lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-71179479-8338-48a4-9f3c-9a1493cb3b2f req-f9c58d96-8d7a-4f3c-bde2-1a3e2b28f0bb service nova] Acquired lock "refresh_cache-7c9ddadf-3e5f-462d-a39d-48078a65b2b7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.neutron [req-71179479-8338-48a4-9f3c-9a1493cb3b2f req-f9c58d96-8d7a-4f3c-bde2-1a3e2b28f0bb service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Refreshing network info cache for port db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Start _get_guest_xml network_info=[{"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:46:04 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:04 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1789489197',display_name='tempest-DeleteServersTestJSON-server-1789489197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1789489197',id=2,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0039914ee924569ae532f388899d331',ramdisk_id='',reservation_id='r-7xlp09au',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1748001576',owner_user_name='tempest-DeleteServersTestJSON-1748001576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:45:54Z,user_data=None,user_id='1880545cfe1a4ecf9a3d4e193bb049d5',uuid=7c9ddadf-3e5f-462d-a39d-48078a65b2b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Converting VIF {"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cd:f3,bridge_name='br-int',has_traffic_filtering=True,id=db56f158-81c9-4a49-a2b7-9849362b8620,network=Network(06535742-065a-4197-9b49-42325c6db0d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb56f158-81') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:46:04 user nova-compute[70659]:   <uuid>7c9ddadf-3e5f-462d-a39d-48078a65b2b7</uuid>
Jul 25 16:46:04 user nova-compute[70659]:   <name>instance-00000002</name>
Jul 25 16:46:04 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:46:04 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:46:04 user nova-compute[70659]:   <metadata>
Jul 25 16:46:04 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:46:04 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:46:04 user nova-compute[70659]:       <nova:name>tempest-DeleteServersTestJSON-server-1789489197</nova:name>
Jul 25 16:46:04 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:46:04</nova:creationTime>
Jul 25 16:46:04 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:46:04 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:46:04 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:46:04 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:46:04 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:46:04 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:46:04 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:46:04 user nova-compute[70659]:       <nova:owner>
Jul 25 16:46:04 user nova-compute[70659]:         <nova:user uuid="1880545cfe1a4ecf9a3d4e193bb049d5">tempest-DeleteServersTestJSON-1748001576-project-member</nova:user>
Jul 25 16:46:04 user nova-compute[70659]:         <nova:project uuid="d0039914ee924569ae532f388899d331">tempest-DeleteServersTestJSON-1748001576</nova:project>
Jul 25 16:46:04 user nova-compute[70659]:       </nova:owner>
Jul 25 16:46:04 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:46:04 user nova-compute[70659]:       <nova:ports>
Jul 25 16:46:04 user nova-compute[70659]:         <nova:port uuid="db56f158-81c9-4a49-a2b7-9849362b8620">
Jul 25 16:46:04 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 16:46:04 user nova-compute[70659]:         </nova:port>
Jul 25 16:46:04 user nova-compute[70659]:       </nova:ports>
Jul 25 16:46:04 user nova-compute[70659]:     </nova:instance>
Jul 25 16:46:04 user nova-compute[70659]:   </metadata>
Jul 25 16:46:04 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:46:04 user nova-compute[70659]:     <system>
Jul 25 16:46:04 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:46:04 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:46:04 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:46:04 user nova-compute[70659]:       <entry name="serial">7c9ddadf-3e5f-462d-a39d-48078a65b2b7</entry>
Jul 25 16:46:04 user nova-compute[70659]:       <entry name="uuid">7c9ddadf-3e5f-462d-a39d-48078a65b2b7</entry>
Jul 25 16:46:04 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:46:04 user nova-compute[70659]:     </system>
Jul 25 16:46:04 user nova-compute[70659]:   </sysinfo>
Jul 25 16:46:04 user nova-compute[70659]:   <os>
Jul 25 16:46:04 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:46:04 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:46:04 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:46:04 user nova-compute[70659]:   </os>
Jul 25 16:46:04 user nova-compute[70659]:   <features>
Jul 25 16:46:04 user nova-compute[70659]:     <acpi/>
Jul 25 16:46:04 user nova-compute[70659]:     <apic/>
Jul 25 16:46:04 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:46:04 user nova-compute[70659]:   </features>
Jul 25 16:46:04 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:46:04 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:46:04 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:46:04 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:46:04 user nova-compute[70659]:   </clock>
Jul 25 16:46:04 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:46:04 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:46:04 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:46:04 user nova-compute[70659]:   </cpu>
Jul 25 16:46:04 user nova-compute[70659]:   <devices>
Jul 25 16:46:04 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:46:04 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:46:04 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk"/>
Jul 25 16:46:04 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:46:04 user nova-compute[70659]:     </disk>
Jul 25 16:46:04 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:46:04 user nova-compute[70659]:       <mac address="fa:16:3e:8c:cd:f3"/>
Jul 25 16:46:04 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:04 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:46:04 user nova-compute[70659]:       <target dev="tapdb56f158-81"/>
Jul 25 16:46:04 user nova-compute[70659]:     </interface>
Jul 25 16:46:04 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:46:04 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/console.log" append="off"/>
Jul 25 16:46:04 user nova-compute[70659]:     </serial>
Jul 25 16:46:04 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:46:04 user nova-compute[70659]:     <video>
Jul 25 16:46:04 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:04 user nova-compute[70659]:     </video>
Jul 25 16:46:04 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:46:04 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:46:04 user nova-compute[70659]:     </rng>
Jul 25 16:46:04 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:46:04 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:46:04 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:46:04 user nova-compute[70659]:     </memballoon>
Jul 25 16:46:04 user nova-compute[70659]:   </devices>
Jul 25 16:46:04 user nova-compute[70659]: </domain>
Jul 25 16:46:04 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1789489197',display_name='tempest-DeleteServersTestJSON-server-1789489197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1789489197',id=2,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0039914ee924569ae532f388899d331',ramdisk_id='',reservation_id='r-7xlp09au',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1748001576',owner_user_name='tempest-DeleteServersTestJSON-1748001576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:45:54Z,user_data=None,user_id='1880545cfe1a4ecf9a3d4e193bb049d5',uuid=7c9ddadf-3e5f-462d-a39d-48078a65b2b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Converting VIF {"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cd:f3,bridge_name='br-int',has_traffic_filtering=True,id=db56f158-81c9-4a49-a2b7-9849362b8620,network=Network(06535742-065a-4197-9b49-42325c6db0d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb56f158-81') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG os_vif [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cd:f3,bridge_name='br-int',has_traffic_filtering=True,id=db56f158-81c9-4a49-a2b7-9849362b8620,network=Network(06535742-065a-4197-9b49-42325c6db0d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb56f158-81') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb56f158-81, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb56f158-81, col_values=(('external_ids', {'iface-id': 'db56f158-81c9-4a49-a2b7-9849362b8620', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:cd:f3', 'vm-uuid': '7c9ddadf-3e5f-462d-a39d-48078a65b2b7'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: INFO os_vif [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cd:f3,bridge_name='br-int',has_traffic_filtering=True,id=db56f158-81c9-4a49-a2b7-9849362b8620,network=Network(06535742-065a-4197-9b49-42325c6db0d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb56f158-81')
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] No VIF found with MAC fa:16:3e:8c:cd:f3, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:46:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Successfully created port: 219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:46:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-091eeca3-4a65-4090-bfb5-f83248716bc2 req-c903ba22-a142-4158-ae71-d80ff7ea07d0 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-changed-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-091eeca3-4a65-4090-bfb5-f83248716bc2 req-c903ba22-a142-4158-ae71-d80ff7ea07d0 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Refreshing instance network info cache due to event network-changed-f5aac860-4fc0-4097-8275-2243915c868b. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:46:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-091eeca3-4a65-4090-bfb5-f83248716bc2 req-c903ba22-a142-4158-ae71-d80ff7ea07d0 service nova] Acquiring lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updating instance_info_cache with network_info: [{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Releasing lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance network_info: |[{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7418c97b-ac5b-4d79-ab8c-70595039b2a6 req-6fd98fbb-724b-46b0-8250-1f151c4b57e1 service nova] Acquired lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-7418c97b-ac5b-4d79-ab8c-70595039b2a6 req-6fd98fbb-724b-46b0-8250-1f151c4b57e1 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Refreshing network info cache for port 3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Start _get_guest_xml network_info=[{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:46:06 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:06 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252348890',display_name='tempest-AttachVolumeTestJSON-server-1252348890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252348890',id=5,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl7hEIoOzploaaVJzvHH8s9XWd3DqHJQDS4RGFYYAnouMce0kg5Qq6bJLKJ1xPuEcKILYqVCIIw7SRQhcjnOOD1emebVM/xSSTVD/YqNbIqjFDTdfW8AR1dAleT+Ed0Qw==',key_name='tempest-keypair-1208202396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-dwrzw3y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=9df22b5f-c0e3-4eb5-9054-c593d0660ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'pci_devices' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:46:06 user nova-compute[70659]:   <uuid>9df22b5f-c0e3-4eb5-9054-c593d0660ee5</uuid>
Jul 25 16:46:06 user nova-compute[70659]:   <name>instance-00000005</name>
Jul 25 16:46:06 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:46:06 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:46:06 user nova-compute[70659]:   <metadata>
Jul 25 16:46:06 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:46:06 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeTestJSON-server-1252348890</nova:name>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:46:06</nova:creationTime>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:46:06 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:46:06 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:owner>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:user uuid="a77a77d2b1954c10ace66ba38fd9ff6c">tempest-AttachVolumeTestJSON-212658614-project-member</nova:user>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:project uuid="07de6ba95db444b5b10d51ef16525948">tempest-AttachVolumeTestJSON-212658614</nova:project>
Jul 25 16:46:06 user nova-compute[70659]:       </nova:owner>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:ports>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:port uuid="3c7f2734-73c4-4648-a080-0ea25238dad8">
Jul 25 16:46:06 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 16:46:06 user nova-compute[70659]:         </nova:port>
Jul 25 16:46:06 user nova-compute[70659]:       </nova:ports>
Jul 25 16:46:06 user nova-compute[70659]:     </nova:instance>
Jul 25 16:46:06 user nova-compute[70659]:   </metadata>
Jul 25 16:46:06 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:46:06 user nova-compute[70659]:     <system>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="serial">9df22b5f-c0e3-4eb5-9054-c593d0660ee5</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="uuid">9df22b5f-c0e3-4eb5-9054-c593d0660ee5</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:46:06 user nova-compute[70659]:     </system>
Jul 25 16:46:06 user nova-compute[70659]:   </sysinfo>
Jul 25 16:46:06 user nova-compute[70659]:   <os>
Jul 25 16:46:06 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:46:06 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:46:06 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:46:06 user nova-compute[70659]:   </os>
Jul 25 16:46:06 user nova-compute[70659]:   <features>
Jul 25 16:46:06 user nova-compute[70659]:     <acpi/>
Jul 25 16:46:06 user nova-compute[70659]:     <apic/>
Jul 25 16:46:06 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:46:06 user nova-compute[70659]:   </features>
Jul 25 16:46:06 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:46:06 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:46:06 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:46:06 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:46:06 user nova-compute[70659]:   </clock>
Jul 25 16:46:06 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:46:06 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:46:06 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:46:06 user nova-compute[70659]:   </cpu>
Jul 25 16:46:06 user nova-compute[70659]:   <devices>
Jul 25 16:46:06 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:46:06 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:46:06 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk"/>
Jul 25 16:46:06 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:46:06 user nova-compute[70659]:     </disk>
Jul 25 16:46:06 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:46:06 user nova-compute[70659]:       <mac address="fa:16:3e:ea:f3:27"/>
Jul 25 16:46:06 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:06 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:46:06 user nova-compute[70659]:       <target dev="tap3c7f2734-73"/>
Jul 25 16:46:06 user nova-compute[70659]:     </interface>
Jul 25 16:46:06 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:46:06 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/console.log" append="off"/>
Jul 25 16:46:06 user nova-compute[70659]:     </serial>
Jul 25 16:46:06 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:46:06 user nova-compute[70659]:     <video>
Jul 25 16:46:06 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:06 user nova-compute[70659]:     </video>
Jul 25 16:46:06 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:46:06 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:46:06 user nova-compute[70659]:     </rng>
Jul 25 16:46:06 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:46:06 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:46:06 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:46:06 user nova-compute[70659]:     </memballoon>
Jul 25 16:46:06 user nova-compute[70659]:   </devices>
Jul 25 16:46:06 user nova-compute[70659]: </domain>
Jul 25 16:46:06 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252348890',display_name='tempest-AttachVolumeTestJSON-server-1252348890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252348890',id=5,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl7hEIoOzploaaVJzvHH8s9XWd3DqHJQDS4RGFYYAnouMce0kg5Qq6bJLKJ1xPuEcKILYqVCIIw7SRQhcjnOOD1emebVM/xSSTVD/YqNbIqjFDTdfW8AR1dAleT+Ed0Qw==',key_name='tempest-keypair-1208202396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-dwrzw3y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=9df22b5f-c0e3-4eb5-9054-c593d0660ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG os_vif [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c7f2734-73, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c7f2734-73, col_values=(('external_ids', {'iface-id': '3c7f2734-73c4-4648-a080-0ea25238dad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:f3:27', 'vm-uuid': '9df22b5f-c0e3-4eb5-9054-c593d0660ee5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: INFO os_vif [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73')
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No VIF found with MAC fa:16:3e:ea:f3:27, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Updating instance_info_cache with network_info: [{"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Releasing lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Instance network_info: |[{"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-091eeca3-4a65-4090-bfb5-f83248716bc2 req-c903ba22-a142-4158-ae71-d80ff7ea07d0 service nova] Acquired lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-091eeca3-4a65-4090-bfb5-f83248716bc2 req-c903ba22-a142-4158-ae71-d80ff7ea07d0 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Refreshing network info cache for port f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Start _get_guest_xml network_info=[{"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:46:06 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:06 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641327865',display_name='tempest-ServerRescueNegativeTestJSON-server-1641327865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641327865',id=3,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-dd57sdib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:45:56Z,user_data=None,user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a0:42,bridge_name='br-int',has_traffic_filtering=True,id=f5aac860-4fc0-4097-8275-2243915c868b,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5aac860-4f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.objects.instance [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'pci_devices' on Instance uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:46:06 user nova-compute[70659]:   <uuid>fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7</uuid>
Jul 25 16:46:06 user nova-compute[70659]:   <name>instance-00000003</name>
Jul 25 16:46:06 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:46:06 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:46:06 user nova-compute[70659]:   <metadata>
Jul 25 16:46:06 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:46:06 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1641327865</nova:name>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:46:06</nova:creationTime>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:46:06 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:46:06 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:owner>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:user uuid="9aaa70e5cce7418b96837e30769ac6aa">tempest-ServerRescueNegativeTestJSON-1539045365-project-member</nova:user>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:project uuid="d20acc57667b418ba16f573fe81841ac">tempest-ServerRescueNegativeTestJSON-1539045365</nova:project>
Jul 25 16:46:06 user nova-compute[70659]:       </nova:owner>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:46:06 user nova-compute[70659]:       <nova:ports>
Jul 25 16:46:06 user nova-compute[70659]:         <nova:port uuid="f5aac860-4fc0-4097-8275-2243915c868b">
Jul 25 16:46:06 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 16:46:06 user nova-compute[70659]:         </nova:port>
Jul 25 16:46:06 user nova-compute[70659]:       </nova:ports>
Jul 25 16:46:06 user nova-compute[70659]:     </nova:instance>
Jul 25 16:46:06 user nova-compute[70659]:   </metadata>
Jul 25 16:46:06 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:46:06 user nova-compute[70659]:     <system>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="serial">fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="uuid">fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7</entry>
Jul 25 16:46:06 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:46:06 user nova-compute[70659]:     </system>
Jul 25 16:46:06 user nova-compute[70659]:   </sysinfo>
Jul 25 16:46:06 user nova-compute[70659]:   <os>
Jul 25 16:46:06 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:46:06 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:46:06 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:46:06 user nova-compute[70659]:   </os>
Jul 25 16:46:06 user nova-compute[70659]:   <features>
Jul 25 16:46:06 user nova-compute[70659]:     <acpi/>
Jul 25 16:46:06 user nova-compute[70659]:     <apic/>
Jul 25 16:46:06 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:46:06 user nova-compute[70659]:   </features>
Jul 25 16:46:06 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:46:06 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:46:06 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:46:06 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:46:06 user nova-compute[70659]:   </clock>
Jul 25 16:46:06 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:46:06 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:46:06 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:46:06 user nova-compute[70659]:   </cpu>
Jul 25 16:46:06 user nova-compute[70659]:   <devices>
Jul 25 16:46:06 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:46:06 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:46:06 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk"/>
Jul 25 16:46:06 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:46:06 user nova-compute[70659]:     </disk>
Jul 25 16:46:06 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:46:06 user nova-compute[70659]:       <mac address="fa:16:3e:c2:a0:42"/>
Jul 25 16:46:06 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:06 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:46:06 user nova-compute[70659]:       <target dev="tapf5aac860-4f"/>
Jul 25 16:46:06 user nova-compute[70659]:     </interface>
Jul 25 16:46:06 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:46:06 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/console.log" append="off"/>
Jul 25 16:46:06 user nova-compute[70659]:     </serial>
Jul 25 16:46:06 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:46:06 user nova-compute[70659]:     <video>
Jul 25 16:46:06 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:06 user nova-compute[70659]:     </video>
Jul 25 16:46:06 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:46:06 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:46:06 user nova-compute[70659]:     </rng>
Jul 25 16:46:06 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:46:06 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:46:06 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:46:06 user nova-compute[70659]:     </memballoon>
Jul 25 16:46:06 user nova-compute[70659]:   </devices>
Jul 25 16:46:06 user nova-compute[70659]: </domain>
Jul 25 16:46:06 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641327865',display_name='tempest-ServerRescueNegativeTestJSON-server-1641327865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641327865',id=3,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-dd57sdib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:45:56Z,user_data=None,user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a0:42,bridge_name='br-int',has_traffic_filtering=True,id=f5aac860-4fc0-4097-8275-2243915c868b,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5aac860-4f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG os_vif [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a0:42,bridge_name='br-int',has_traffic_filtering=True,id=f5aac860-4fc0-4097-8275-2243915c868b,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5aac860-4f') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5aac860-4f, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5aac860-4f, col_values=(('external_ids', {'iface-id': 'f5aac860-4fc0-4097-8275-2243915c868b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:a0:42', 'vm-uuid': 'fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: INFO os_vif [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a0:42,bridge_name='br-int',has_traffic_filtering=True,id=f5aac860-4fc0-4097-8275-2243915c868b,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5aac860-4f')
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-71179479-8338-48a4-9f3c-9a1493cb3b2f req-f9c58d96-8d7a-4f3c-bde2-1a3e2b28f0bb service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Updated VIF entry in instance network info cache for port db56f158-81c9-4a49-a2b7-9849362b8620. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-71179479-8338-48a4-9f3c-9a1493cb3b2f req-f9c58d96-8d7a-4f3c-bde2-1a3e2b28f0bb service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Updating instance_info_cache with network_info: [{"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No VIF found with MAC fa:16:3e:c2:a0:42, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-71179479-8338-48a4-9f3c-9a1493cb3b2f req-f9c58d96-8d7a-4f3c-bde2-1a3e2b28f0bb service nova] Releasing lock "refresh_cache-7c9ddadf-3e5f-462d-a39d-48078a65b2b7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Successfully created port: 8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:46:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-0eaacee7-09dc-4307-88ee-9275744a5c34 req-8f57c6e0-4aee-4a5c-9002-d639478f3ab8 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0eaacee7-09dc-4307-88ee-9275744a5c34 req-8f57c6e0-4aee-4a5c-9002-d639478f3ab8 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0eaacee7-09dc-4307-88ee-9275744a5c34 req-8f57c6e0-4aee-4a5c-9002-d639478f3ab8 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0eaacee7-09dc-4307-88ee-9275744a5c34 req-8f57c6e0-4aee-4a5c-9002-d639478f3ab8 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-0eaacee7-09dc-4307-88ee-9275744a5c34 req-8f57c6e0-4aee-4a5c-9002-d639478f3ab8 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:07 user nova-compute[70659]: WARNING nova.compute.manager [req-0eaacee7-09dc-4307-88ee-9275744a5c34 req-8f57c6e0-4aee-4a5c-9002-d639478f3ab8 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state building and task_state spawning.
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303568.053126, c2800889-2d2e-4660-8bc9-f1f1782587d3 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] VM Resumed (Lifecycle Event)
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Instance spawned successfully.
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Instance spawned successfully.
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303568.0536149, c2800889-2d2e-4660-8bc9-f1f1782587d3 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] VM Started (Lifecycle Event)
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Took 10.41 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303568.0656714, c9728d00-f454-4616-af0b-8cfd0f012cad => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] VM Resumed (Lifecycle Event)
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Took 14.63 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Took 11.41 seconds to build instance.
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303568.0683627, c9728d00-f454-4616-af0b-8cfd0f012cad => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] VM Started (Lifecycle Event)
Jul 25 16:46:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-67eb36e0-0ddd-4e5c-9590-d7df75d1184b tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.559s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:08 user nova-compute[70659]: INFO nova.compute.manager [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Took 15.53 seconds to build instance.
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3549d4f3-e603-4fbf-a1d0-6d856bd65f19 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.746s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-7418c97b-ac5b-4d79-ab8c-70595039b2a6 req-6fd98fbb-724b-46b0-8250-1f151c4b57e1 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updated VIF entry in instance network info cache for port 3c7f2734-73c4-4648-a080-0ea25238dad8. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-7418c97b-ac5b-4d79-ab8c-70595039b2a6 req-6fd98fbb-724b-46b0-8250-1f151c4b57e1 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updating instance_info_cache with network_info: [{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7418c97b-ac5b-4d79-ab8c-70595039b2a6 req-6fd98fbb-724b-46b0-8250-1f151c4b57e1 service nova] Releasing lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-091eeca3-4a65-4090-bfb5-f83248716bc2 req-c903ba22-a142-4158-ae71-d80ff7ea07d0 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Updated VIF entry in instance network info cache for port f5aac860-4fc0-4097-8275-2243915c868b. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-091eeca3-4a65-4090-bfb5-f83248716bc2 req-c903ba22-a142-4158-ae71-d80ff7ea07d0 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Updating instance_info_cache with network_info: [{"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-091eeca3-4a65-4090-bfb5-f83248716bc2 req-c903ba22-a142-4158-ae71-d80ff7ea07d0 service nova] Releasing lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Successfully updated port: 219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquired lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-c4a6101f-2205-4e44-8ec0-2402776aada8 req-2be0e59a-04cc-4245-9c10-bdac60b7a53f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-changed-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-c4a6101f-2205-4e44-8ec0-2402776aada8 req-2be0e59a-04cc-4245-9c10-bdac60b7a53f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Refreshing instance network info cache due to event network-changed-219a0a7f-2318-4e5c-b5da-9f9bf813174a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:46:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4a6101f-2205-4e44-8ec0-2402776aada8 req-2be0e59a-04cc-4245-9c10-bdac60b7a53f service nova] Acquiring lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:10 user nova-compute[70659]: WARNING nova.compute.manager [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state active and task_state None.
Jul 25 16:46:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received event network-vif-plugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] Acquiring lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] No waiting events found dispatching network-vif-plugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:10 user nova-compute[70659]: WARNING nova.compute.manager [req-011b7dab-3aa6-45bb-963c-9c24d1b81d93 req-ba55b55d-084b-423b-8516-6f3d3d4ef013 service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received unexpected event network-vif-plugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a for instance with vm_state active and task_state None.
Jul 25 16:46:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.network.neutron [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Successfully updated port: 8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquired lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.network.neutron [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.network.neutron [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating instance_info_cache with network_info: [{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Releasing lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance network_info: |[{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4a6101f-2205-4e44-8ec0-2402776aada8 req-2be0e59a-04cc-4245-9c10-bdac60b7a53f service nova] Acquired lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.network.neutron [req-c4a6101f-2205-4e44-8ec0-2402776aada8 req-2be0e59a-04cc-4245-9c10-bdac60b7a53f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Refreshing network info cache for port 219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Start _get_guest_xml network_info=[{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:46:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-905791245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-905791245',id=6,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOymDjzlIsiz32bRLLU6vehbllh7+WKErUo8ql1bWnzAC3zORdhGDdr8wCoOVTjNchVn98dkc5ViScdVeOVpOsKe6iiUnM/m0wVkj/O7mSoMFcB+Dbqwp/I0fkYoPqM7xA==',key_name='tempest-keypair-37424022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-xzwkg0n4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:46:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:46:12 user nova-compute[70659]:   <uuid>9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a</uuid>
Jul 25 16:46:12 user nova-compute[70659]:   <name>instance-00000006</name>
Jul 25 16:46:12 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:46:12 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:46:12 user nova-compute[70659]:   <metadata>
Jul 25 16:46:12 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:46:12 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:46:12 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-905791245</nova:name>
Jul 25 16:46:12 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:46:11</nova:creationTime>
Jul 25 16:46:12 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:46:12 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:46:12 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:46:12 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:46:12 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:46:12 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:46:12 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:46:12 user nova-compute[70659]:       <nova:owner>
Jul 25 16:46:12 user nova-compute[70659]:         <nova:user uuid="bd26fb262d7b47638bb0a0df0ea10c24">tempest-AttachVolumeShelveTestJSON-569325814-project-member</nova:user>
Jul 25 16:46:12 user nova-compute[70659]:         <nova:project uuid="6b9ac672b01748d191239756a58474c3">tempest-AttachVolumeShelveTestJSON-569325814</nova:project>
Jul 25 16:46:12 user nova-compute[70659]:       </nova:owner>
Jul 25 16:46:12 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:46:12 user nova-compute[70659]:       <nova:ports>
Jul 25 16:46:12 user nova-compute[70659]:         <nova:port uuid="219a0a7f-2318-4e5c-b5da-9f9bf813174a">
Jul 25 16:46:12 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:46:12 user nova-compute[70659]:         </nova:port>
Jul 25 16:46:12 user nova-compute[70659]:       </nova:ports>
Jul 25 16:46:12 user nova-compute[70659]:     </nova:instance>
Jul 25 16:46:12 user nova-compute[70659]:   </metadata>
Jul 25 16:46:12 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:46:12 user nova-compute[70659]:     <system>
Jul 25 16:46:12 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:46:12 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:46:12 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:46:12 user nova-compute[70659]:       <entry name="serial">9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a</entry>
Jul 25 16:46:12 user nova-compute[70659]:       <entry name="uuid">9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a</entry>
Jul 25 16:46:12 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:46:12 user nova-compute[70659]:     </system>
Jul 25 16:46:12 user nova-compute[70659]:   </sysinfo>
Jul 25 16:46:12 user nova-compute[70659]:   <os>
Jul 25 16:46:12 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:46:12 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:46:12 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:46:12 user nova-compute[70659]:   </os>
Jul 25 16:46:12 user nova-compute[70659]:   <features>
Jul 25 16:46:12 user nova-compute[70659]:     <acpi/>
Jul 25 16:46:12 user nova-compute[70659]:     <apic/>
Jul 25 16:46:12 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:46:12 user nova-compute[70659]:   </features>
Jul 25 16:46:12 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:46:12 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:46:12 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:46:12 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:46:12 user nova-compute[70659]:   </clock>
Jul 25 16:46:12 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:46:12 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:46:12 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:46:12 user nova-compute[70659]:   </cpu>
Jul 25 16:46:12 user nova-compute[70659]:   <devices>
Jul 25 16:46:12 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:46:12 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:46:12 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk"/>
Jul 25 16:46:12 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:46:12 user nova-compute[70659]:     </disk>
Jul 25 16:46:12 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:46:12 user nova-compute[70659]:       <mac address="fa:16:3e:6a:13:1f"/>
Jul 25 16:46:12 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:12 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:46:12 user nova-compute[70659]:       <target dev="tap219a0a7f-23"/>
Jul 25 16:46:12 user nova-compute[70659]:     </interface>
Jul 25 16:46:12 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:46:12 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/console.log" append="off"/>
Jul 25 16:46:12 user nova-compute[70659]:     </serial>
Jul 25 16:46:12 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:46:12 user nova-compute[70659]:     <video>
Jul 25 16:46:12 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:12 user nova-compute[70659]:     </video>
Jul 25 16:46:12 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:46:12 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:46:12 user nova-compute[70659]:     </rng>
Jul 25 16:46:12 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:46:12 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:46:12 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:46:12 user nova-compute[70659]:     </memballoon>
Jul 25 16:46:12 user nova-compute[70659]:   </devices>
Jul 25 16:46:12 user nova-compute[70659]: </domain>
Jul 25 16:46:12 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-905791245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-905791245',id=6,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOymDjzlIsiz32bRLLU6vehbllh7+WKErUo8ql1bWnzAC3zORdhGDdr8wCoOVTjNchVn98dkc5ViScdVeOVpOsKe6iiUnM/m0wVkj/O7mSoMFcB+Dbqwp/I0fkYoPqM7xA==',key_name='tempest-keypair-37424022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-xzwkg0n4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG os_vif [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap219a0a7f-23, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap219a0a7f-23, col_values=(('external_ids', {'iface-id': '219a0a7f-2318-4e5c-b5da-9f9bf813174a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:13:1f', 'vm-uuid': '9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:12 user nova-compute[70659]: INFO os_vif [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23')
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-13aaea3e-2b04-483b-9924-82e18b496ade req-b5ab7ee3-136f-45b5-95a1-87f6dedf7fcb service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-13aaea3e-2b04-483b-9924-82e18b496ade req-b5ab7ee3-136f-45b5-95a1-87f6dedf7fcb service nova] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-13aaea3e-2b04-483b-9924-82e18b496ade req-b5ab7ee3-136f-45b5-95a1-87f6dedf7fcb service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-13aaea3e-2b04-483b-9924-82e18b496ade req-b5ab7ee3-136f-45b5-95a1-87f6dedf7fcb service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-13aaea3e-2b04-483b-9924-82e18b496ade req-b5ab7ee3-136f-45b5-95a1-87f6dedf7fcb service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] No waiting events found dispatching network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:12 user nova-compute[70659]: WARNING nova.compute.manager [req-13aaea3e-2b04-483b-9924-82e18b496ade req-b5ab7ee3-136f-45b5-95a1-87f6dedf7fcb service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received unexpected event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b for instance with vm_state building and task_state spawning.
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] No VIF found with MAC fa:16:3e:6a:13:1f, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received event network-vif-plugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] Acquiring lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] No waiting events found dispatching network-vif-plugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:12 user nova-compute[70659]: WARNING nova.compute.manager [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received unexpected event network-vif-plugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a for instance with vm_state active and task_state None.
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-changed-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Refreshing instance network info cache due to event network-changed-8f746e90-8b94-4b8c-8c13-02df5983ced0. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] Acquiring lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303573.1427886, 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] VM Resumed (Lifecycle Event)
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Instance spawned successfully.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303573.1483402, 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] VM Started (Lifecycle Event)
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance_info_cache with network_info: [{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Releasing lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance network_info: |[{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] Acquired lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.network.neutron [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Refreshing network info cache for port 8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Start _get_guest_xml network_info=[{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:13 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:13 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303573.3351707, fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] VM Resumed (Lifecycle Event)
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1071496954',display_name='tempest-ServerActionsTestOtherB-server-1071496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1071496954',id=7,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWJlFb4j8Ys1CPB/bDiS40Ugcuw2Q/xoj3AvPfDyBBFFTZke2FjMd2/DfM6CM24MZfC34jM3nOUoDm3L0rcAn9FD/4h8gEUHn4G9Y2qb8q+bjHLww9szHUFjYPz7u30g==',key_name='tempest-keypair-329454245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb25024c830544d682f76d9dc10171e2',ramdisk_id='',reservation_id='r-y1z79cx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1921270631',owner_user_name='tempest-ServerActionsTestOtherB-1921270631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ebfb3f4c65f4e16be5234a8a4e99e3c',uuid=5192b767-96f0-4789-ac74-0d6d6b5bef3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converting VIF {"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.objects.instance [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'pci_devices' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Instance spawned successfully.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Took 19.50 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:46:13 user nova-compute[70659]:   <uuid>5192b767-96f0-4789-ac74-0d6d6b5bef3e</uuid>
Jul 25 16:46:13 user nova-compute[70659]:   <name>instance-00000007</name>
Jul 25 16:46:13 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:46:13 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:46:13 user nova-compute[70659]:   <metadata>
Jul 25 16:46:13 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:46:13 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:46:13 user nova-compute[70659]:       <nova:name>tempest-ServerActionsTestOtherB-server-1071496954</nova:name>
Jul 25 16:46:13 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:46:13</nova:creationTime>
Jul 25 16:46:13 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:46:13 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:46:13 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:46:13 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:46:13 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:46:13 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:46:13 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:46:13 user nova-compute[70659]:       <nova:owner>
Jul 25 16:46:13 user nova-compute[70659]:         <nova:user uuid="1ebfb3f4c65f4e16be5234a8a4e99e3c">tempest-ServerActionsTestOtherB-1921270631-project-member</nova:user>
Jul 25 16:46:13 user nova-compute[70659]:         <nova:project uuid="eb25024c830544d682f76d9dc10171e2">tempest-ServerActionsTestOtherB-1921270631</nova:project>
Jul 25 16:46:13 user nova-compute[70659]:       </nova:owner>
Jul 25 16:46:13 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:46:13 user nova-compute[70659]:       <nova:ports>
Jul 25 16:46:13 user nova-compute[70659]:         <nova:port uuid="8f746e90-8b94-4b8c-8c13-02df5983ced0">
Jul 25 16:46:13 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 16:46:13 user nova-compute[70659]:         </nova:port>
Jul 25 16:46:13 user nova-compute[70659]:       </nova:ports>
Jul 25 16:46:13 user nova-compute[70659]:     </nova:instance>
Jul 25 16:46:13 user nova-compute[70659]:   </metadata>
Jul 25 16:46:13 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:46:13 user nova-compute[70659]:     <system>
Jul 25 16:46:13 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:46:13 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:46:13 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:46:13 user nova-compute[70659]:       <entry name="serial">5192b767-96f0-4789-ac74-0d6d6b5bef3e</entry>
Jul 25 16:46:13 user nova-compute[70659]:       <entry name="uuid">5192b767-96f0-4789-ac74-0d6d6b5bef3e</entry>
Jul 25 16:46:13 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:46:13 user nova-compute[70659]:     </system>
Jul 25 16:46:13 user nova-compute[70659]:   </sysinfo>
Jul 25 16:46:13 user nova-compute[70659]:   <os>
Jul 25 16:46:13 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:46:13 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:46:13 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:46:13 user nova-compute[70659]:   </os>
Jul 25 16:46:13 user nova-compute[70659]:   <features>
Jul 25 16:46:13 user nova-compute[70659]:     <acpi/>
Jul 25 16:46:13 user nova-compute[70659]:     <apic/>
Jul 25 16:46:13 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:46:13 user nova-compute[70659]:   </features>
Jul 25 16:46:13 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:46:13 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:46:13 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:46:13 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:46:13 user nova-compute[70659]:   </clock>
Jul 25 16:46:13 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:46:13 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:46:13 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:46:13 user nova-compute[70659]:   </cpu>
Jul 25 16:46:13 user nova-compute[70659]:   <devices>
Jul 25 16:46:13 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:46:13 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:46:13 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk"/>
Jul 25 16:46:13 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:46:13 user nova-compute[70659]:     </disk>
Jul 25 16:46:13 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:46:13 user nova-compute[70659]:       <mac address="fa:16:3e:3b:ca:b5"/>
Jul 25 16:46:13 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:13 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:46:13 user nova-compute[70659]:       <target dev="tap8f746e90-8b"/>
Jul 25 16:46:13 user nova-compute[70659]:     </interface>
Jul 25 16:46:13 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:46:13 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/console.log" append="off"/>
Jul 25 16:46:13 user nova-compute[70659]:     </serial>
Jul 25 16:46:13 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:46:13 user nova-compute[70659]:     <video>
Jul 25 16:46:13 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:13 user nova-compute[70659]:     </video>
Jul 25 16:46:13 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:46:13 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:46:13 user nova-compute[70659]:     </rng>
Jul 25 16:46:13 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:46:13 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:46:13 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:46:13 user nova-compute[70659]:     </memballoon>
Jul 25 16:46:13 user nova-compute[70659]:   </devices>
Jul 25 16:46:13 user nova-compute[70659]: </domain>
Jul 25 16:46:13 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1071496954',display_name='tempest-ServerActionsTestOtherB-server-1071496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1071496954',id=7,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWJlFb4j8Ys1CPB/bDiS40Ugcuw2Q/xoj3AvPfDyBBFFTZke2FjMd2/DfM6CM24MZfC34jM3nOUoDm3L0rcAn9FD/4h8gEUHn4G9Y2qb8q+bjHLww9szHUFjYPz7u30g==',key_name='tempest-keypair-329454245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb25024c830544d682f76d9dc10171e2',ramdisk_id='',reservation_id='r-y1z79cx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1921270631',owner_user_name='tempest-ServerActionsTestOtherB-1921270631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ebfb3f4c65f4e16be5234a8a4e99e3c',uuid=5192b767-96f0-4789-ac74-0d6d6b5bef3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converting VIF {"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG os_vif [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f746e90-8b, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f746e90-8b, col_values=(('external_ids', {'iface-id': '8f746e90-8b94-4b8c-8c13-02df5983ced0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ca:b5', 'vm-uuid': '5192b767-96f0-4789-ac74-0d6d6b5bef3e'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance spawned successfully.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303573.3353286, fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] VM Started (Lifecycle Event)
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: INFO os_vif [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b')
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303573.4794574, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] VM Resumed (Lifecycle Event)
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Took 12.81 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Took 18.09 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Took 20.64 seconds to build instance.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] No VIF found with MAC fa:16:3e:3b:ca:b5, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2731e755-5d29-4741-bde1-4b0935e6932c tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.879s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303573.4846702, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:13 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] VM Started (Lifecycle Event)
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:14 user nova-compute[70659]: INFO nova.compute.manager [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Took 13.83 seconds to build instance.
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7404f93b-f0b0-4708-9b6a-e9f51fa42797 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.042s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:14 user nova-compute[70659]: INFO nova.compute.manager [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Took 19.04 seconds to build instance.
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-19ee5313-e5e8-4e85-8453-d367dcc9c70e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.172s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-58e48a9d-20ff-4762-ae98-1e278526771d req-2cb4d5af-da0a-449a-aa6f-c2879403ea95 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-58e48a9d-20ff-4762-ae98-1e278526771d req-2cb4d5af-da0a-449a-aa6f-c2879403ea95 service nova] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-58e48a9d-20ff-4762-ae98-1e278526771d req-2cb4d5af-da0a-449a-aa6f-c2879403ea95 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-58e48a9d-20ff-4762-ae98-1e278526771d req-2cb4d5af-da0a-449a-aa6f-c2879403ea95 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-58e48a9d-20ff-4762-ae98-1e278526771d req-2cb4d5af-da0a-449a-aa6f-c2879403ea95 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] No waiting events found dispatching network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:14 user nova-compute[70659]: WARNING nova.compute.manager [req-58e48a9d-20ff-4762-ae98-1e278526771d req-2cb4d5af-da0a-449a-aa6f-c2879403ea95 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received unexpected event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b for instance with vm_state active and task_state None.
Jul 25 16:46:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received event network-vif-plugged-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] Acquiring lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] No waiting events found dispatching network-vif-plugged-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:14 user nova-compute[70659]: WARNING nova.compute.manager [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received unexpected event network-vif-plugged-db56f158-81c9-4a49-a2b7-9849362b8620 for instance with vm_state active and task_state None.
Jul 25 16:46:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received event network-vif-plugged-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] Acquiring lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] No waiting events found dispatching network-vif-plugged-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:14 user nova-compute[70659]: WARNING nova.compute.manager [req-705f3a16-1786-4741-a438-12c8f2252d4a req-732d87c2-b2a4-4cf2-a426-5e5fc25a371c service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received unexpected event network-vif-plugged-db56f158-81c9-4a49-a2b7-9849362b8620 for instance with vm_state active and task_state None.
Jul 25 16:46:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG nova.network.neutron [req-c4a6101f-2205-4e44-8ec0-2402776aada8 req-2be0e59a-04cc-4245-9c10-bdac60b7a53f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updated VIF entry in instance network info cache for port 219a0a7f-2318-4e5c-b5da-9f9bf813174a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG nova.network.neutron [req-c4a6101f-2205-4e44-8ec0-2402776aada8 req-2be0e59a-04cc-4245-9c10-bdac60b7a53f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating instance_info_cache with network_info: [{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4a6101f-2205-4e44-8ec0-2402776aada8 req-2be0e59a-04cc-4245-9c10-bdac60b7a53f service nova] Releasing lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-f57d570d-e615-444f-8a1c-f4294656d255 req-00bd2be0-5536-456f-a496-36325622e49b service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f57d570d-e615-444f-8a1c-f4294656d255 req-00bd2be0-5536-456f-a496-36325622e49b service nova] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f57d570d-e615-444f-8a1c-f4294656d255 req-00bd2be0-5536-456f-a496-36325622e49b service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f57d570d-e615-444f-8a1c-f4294656d255 req-00bd2be0-5536-456f-a496-36325622e49b service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-f57d570d-e615-444f-8a1c-f4294656d255 req-00bd2be0-5536-456f-a496-36325622e49b service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] No waiting events found dispatching network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:15 user nova-compute[70659]: WARNING nova.compute.manager [req-f57d570d-e615-444f-8a1c-f4294656d255 req-00bd2be0-5536-456f-a496-36325622e49b service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received unexpected event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a for instance with vm_state building and task_state spawning.
Jul 25 16:46:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updated VIF entry in instance network info cache for port 8f746e90-8b94-4b8c-8c13-02df5983ced0. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance_info_cache with network_info: [{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bc273925-4b21-44ae-8992-0a483e44da6a req-327f8ca4-435a-4b4b-8ec7-43fed34daa2d service nova] Releasing lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-7f974a32-4e6a-4318-acc0-930d16a39ad8 req-4d60f9ff-41eb-48f2-bff5-b11ed7f9b719 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f974a32-4e6a-4318-acc0-930d16a39ad8 req-4d60f9ff-41eb-48f2-bff5-b11ed7f9b719 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f974a32-4e6a-4318-acc0-930d16a39ad8 req-4d60f9ff-41eb-48f2-bff5-b11ed7f9b719 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f974a32-4e6a-4318-acc0-930d16a39ad8 req-4d60f9ff-41eb-48f2-bff5-b11ed7f9b719 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-7f974a32-4e6a-4318-acc0-930d16a39ad8 req-4d60f9ff-41eb-48f2-bff5-b11ed7f9b719 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:16 user nova-compute[70659]: WARNING nova.compute.manager [req-7f974a32-4e6a-4318-acc0-930d16a39ad8 req-4d60f9ff-41eb-48f2-bff5-b11ed7f9b719 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state active and task_state None.
Jul 25 16:46:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-f285b59f-3eed-49d0-9b1a-3c3cfe6dee7a req-fb8ed3b9-9362-4038-91b5-91a36e9e6e9f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f285b59f-3eed-49d0-9b1a-3c3cfe6dee7a req-fb8ed3b9-9362-4038-91b5-91a36e9e6e9f service nova] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f285b59f-3eed-49d0-9b1a-3c3cfe6dee7a req-fb8ed3b9-9362-4038-91b5-91a36e9e6e9f service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f285b59f-3eed-49d0-9b1a-3c3cfe6dee7a req-fb8ed3b9-9362-4038-91b5-91a36e9e6e9f service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-f285b59f-3eed-49d0-9b1a-3c3cfe6dee7a req-fb8ed3b9-9362-4038-91b5-91a36e9e6e9f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] No waiting events found dispatching network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:17 user nova-compute[70659]: WARNING nova.compute.manager [req-f285b59f-3eed-49d0-9b1a-3c3cfe6dee7a req-fb8ed3b9-9362-4038-91b5-91a36e9e6e9f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received unexpected event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a for instance with vm_state building and task_state spawning.
Jul 25 16:46:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-d03631d5-46a1-4f74-b559-fccfb6f39de2 req-c862840a-70bb-4bc6-881f-a20a49ee72f3 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d03631d5-46a1-4f74-b559-fccfb6f39de2 req-c862840a-70bb-4bc6-881f-a20a49ee72f3 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d03631d5-46a1-4f74-b559-fccfb6f39de2 req-c862840a-70bb-4bc6-881f-a20a49ee72f3 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d03631d5-46a1-4f74-b559-fccfb6f39de2 req-c862840a-70bb-4bc6-881f-a20a49ee72f3 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-d03631d5-46a1-4f74-b559-fccfb6f39de2 req-c862840a-70bb-4bc6-881f-a20a49ee72f3 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:18 user nova-compute[70659]: WARNING nova.compute.manager [req-d03631d5-46a1-4f74-b559-fccfb6f39de2 req-c862840a-70bb-4bc6-881f-a20a49ee72f3 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state active and task_state None.
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303579.726499, 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:19 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] VM Resumed (Lifecycle Event)
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance spawned successfully.
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:19 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303579.7419846, 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:19 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] VM Started (Lifecycle Event)
Jul 25 16:46:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:20 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:20 user nova-compute[70659]: INFO nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Took 17.30 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:20 user nova-compute[70659]: INFO nova.compute.manager [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Took 18.58 seconds to build instance.
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303580.3753347, 5192b767-96f0-4789-ac74-0d6d6b5bef3e => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:20 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] VM Resumed (Lifecycle Event)
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:20 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance spawned successfully.
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2640d976-bdd6-4810-ac05-6af1def284d3 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.824s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:20 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303580.4137788, 5192b767-96f0-4789-ac74-0d6d6b5bef3e => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:20 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] VM Started (Lifecycle Event)
Jul 25 16:46:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:20 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:20 user nova-compute[70659]: INFO nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Took 17.50 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:21 user nova-compute[70659]: WARNING nova.compute.manager [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state building and task_state spawning.
Jul 25 16:46:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:21 user nova-compute[70659]: WARNING nova.compute.manager [req-4aee31e2-009b-418a-8960-060ef397bddf req-2f870ac3-3f25-4d06-8a25-53875f4738e9 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state building and task_state spawning.
Jul 25 16:46:21 user nova-compute[70659]: INFO nova.compute.manager [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Took 19.37 seconds to build instance.
Jul 25 16:46:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-af865766-7462-49ec-8016-9a37d2547ca6 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.568s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:46:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:22 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:46:22 user nova-compute[70659]: INFO nova.compute.claims [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Claim successful on node user
Jul 25 16:46:23 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.908s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:23 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:46:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG nova.policy [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3c840bf6c1a438bb2e28e2582e6d7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6ebfc7cdb0435287b8e82062151463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:46:23 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Creating image(s)
Jul 25 16:46:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.170s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.171s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk 1073741824" returned: 0 in 0.066s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Cannot resize image /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG nova.objects.instance [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lazy-loading 'migration_context' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Ensure instance console log exists: /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:25 user nova-compute[70659]: DEBUG nova.network.neutron [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Successfully created port: 22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:46:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:28 user nova-compute[70659]: DEBUG nova.network.neutron [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Successfully updated port: 22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:46:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquired lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:28 user nova-compute[70659]: DEBUG nova.network.neutron [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:46:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-9ab4ff02-579f-4075-8f33-22141cc4bab8 req-ea796845-525e-41da-a9df-2e302106175a service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-changed-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-9ab4ff02-579f-4075-8f33-22141cc4bab8 req-ea796845-525e-41da-a9df-2e302106175a service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Refreshing instance network info cache due to event network-changed-22b9f6ed-8f52-4a52-84e9-098f874d5682. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:46:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9ab4ff02-579f-4075-8f33-22141cc4bab8 req-ea796845-525e-41da-a9df-2e302106175a service nova] Acquiring lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:28 user nova-compute[70659]: DEBUG nova.network.neutron [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.network.neutron [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updating instance_info_cache with network_info: [{"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Releasing lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Instance network_info: |[{"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9ab4ff02-579f-4075-8f33-22141cc4bab8 req-ea796845-525e-41da-a9df-2e302106175a service nova] Acquired lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.network.neutron [req-9ab4ff02-579f-4075-8f33-22141cc4bab8 req-ea796845-525e-41da-a9df-2e302106175a service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Refreshing network info cache for port 22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Start _get_guest_xml network_info=[{"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:46:29 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:29 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1506231380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1506231380',id=8,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASmEG7RFCQFi+1G28n7yNAKzcoCuwcnKcQdXmSbHnxoTEkTop7z5XfU9a4Z/QnRF+riya1mdEECpaqnVJkE7ons8sjRqycUy7lP2+85LLnF913u1TMT3K9a21H+JzyCuw==',key_name='tempest-keypair-1108947464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c6ebfc7cdb0435287b8e82062151463',ramdisk_id='',reservation_id='r-natyacfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1788409359',owner_user_name='tempest-TaggedAttachmentsTest-1788409359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c840bf6c1a438bb2e28e2582e6d7fa',uuid=d437efde-81a8-4be0-b9f8-7a34ee7fea3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converting VIF {"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:35:58,bridge_name='br-int',has_traffic_filtering=True,id=22b9f6ed-8f52-4a52-84e9-098f874d5682,network=Network(a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b9f6ed-8f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.objects.instance [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lazy-loading 'pci_devices' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:46:29 user nova-compute[70659]:   <uuid>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</uuid>
Jul 25 16:46:29 user nova-compute[70659]:   <name>instance-00000008</name>
Jul 25 16:46:29 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:46:29 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:46:29 user nova-compute[70659]:   <metadata>
Jul 25 16:46:29 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:46:29 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:46:29 user nova-compute[70659]:       <nova:name>tempest-device-tagging-server-1506231380</nova:name>
Jul 25 16:46:29 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:46:29</nova:creationTime>
Jul 25 16:46:29 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:46:29 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:46:29 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:46:29 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:46:29 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:46:29 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:46:29 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:46:29 user nova-compute[70659]:       <nova:owner>
Jul 25 16:46:29 user nova-compute[70659]:         <nova:user uuid="c3c840bf6c1a438bb2e28e2582e6d7fa">tempest-TaggedAttachmentsTest-1788409359-project-member</nova:user>
Jul 25 16:46:29 user nova-compute[70659]:         <nova:project uuid="0c6ebfc7cdb0435287b8e82062151463">tempest-TaggedAttachmentsTest-1788409359</nova:project>
Jul 25 16:46:29 user nova-compute[70659]:       </nova:owner>
Jul 25 16:46:29 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:46:29 user nova-compute[70659]:       <nova:ports>
Jul 25 16:46:29 user nova-compute[70659]:         <nova:port uuid="22b9f6ed-8f52-4a52-84e9-098f874d5682">
Jul 25 16:46:29 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:46:29 user nova-compute[70659]:         </nova:port>
Jul 25 16:46:29 user nova-compute[70659]:       </nova:ports>
Jul 25 16:46:29 user nova-compute[70659]:     </nova:instance>
Jul 25 16:46:29 user nova-compute[70659]:   </metadata>
Jul 25 16:46:29 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:46:29 user nova-compute[70659]:     <system>
Jul 25 16:46:29 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:46:29 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:46:29 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:46:29 user nova-compute[70659]:       <entry name="serial">d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:46:29 user nova-compute[70659]:       <entry name="uuid">d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:46:29 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:46:29 user nova-compute[70659]:     </system>
Jul 25 16:46:29 user nova-compute[70659]:   </sysinfo>
Jul 25 16:46:29 user nova-compute[70659]:   <os>
Jul 25 16:46:29 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:46:29 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:46:29 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:46:29 user nova-compute[70659]:   </os>
Jul 25 16:46:29 user nova-compute[70659]:   <features>
Jul 25 16:46:29 user nova-compute[70659]:     <acpi/>
Jul 25 16:46:29 user nova-compute[70659]:     <apic/>
Jul 25 16:46:29 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:46:29 user nova-compute[70659]:   </features>
Jul 25 16:46:29 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:46:29 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:46:29 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:46:29 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:46:29 user nova-compute[70659]:   </clock>
Jul 25 16:46:29 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:46:29 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:46:29 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:46:29 user nova-compute[70659]:   </cpu>
Jul 25 16:46:29 user nova-compute[70659]:   <devices>
Jul 25 16:46:29 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:46:29 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:46:29 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk"/>
Jul 25 16:46:29 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:46:29 user nova-compute[70659]:     </disk>
Jul 25 16:46:29 user nova-compute[70659]:     <disk type="file" device="cdrom">
Jul 25 16:46:29 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 16:46:29 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.config"/>
Jul 25 16:46:29 user nova-compute[70659]:       <target dev="hda" bus="ide"/>
Jul 25 16:46:29 user nova-compute[70659]:     </disk>
Jul 25 16:46:29 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:46:29 user nova-compute[70659]:       <mac address="fa:16:3e:75:35:58"/>
Jul 25 16:46:29 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:29 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:46:29 user nova-compute[70659]:       <target dev="tap22b9f6ed-8f"/>
Jul 25 16:46:29 user nova-compute[70659]:     </interface>
Jul 25 16:46:29 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:46:29 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log" append="off"/>
Jul 25 16:46:29 user nova-compute[70659]:     </serial>
Jul 25 16:46:29 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:46:29 user nova-compute[70659]:     <video>
Jul 25 16:46:29 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:29 user nova-compute[70659]:     </video>
Jul 25 16:46:29 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:46:29 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:46:29 user nova-compute[70659]:     </rng>
Jul 25 16:46:29 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:46:29 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:46:29 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:46:29 user nova-compute[70659]:     </memballoon>
Jul 25 16:46:29 user nova-compute[70659]:   </devices>
Jul 25 16:46:29 user nova-compute[70659]: </domain>
Jul 25 16:46:29 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1506231380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1506231380',id=8,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASmEG7RFCQFi+1G28n7yNAKzcoCuwcnKcQdXmSbHnxoTEkTop7z5XfU9a4Z/QnRF+riya1mdEECpaqnVJkE7ons8sjRqycUy7lP2+85LLnF913u1TMT3K9a21H+JzyCuw==',key_name='tempest-keypair-1108947464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c6ebfc7cdb0435287b8e82062151463',ramdisk_id='',reservation_id='r-natyacfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1788409359',owner_user_name='tempest-TaggedAttachmentsTest-1788409359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c840bf6c1a438bb2e28e2582e6d7fa',uuid=d437efde-81a8-4be0-b9f8-7a34ee7fea3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converting VIF {"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:35:58,bridge_name='br-int',has_traffic_filtering=True,id=22b9f6ed-8f52-4a52-84e9-098f874d5682,network=Network(a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b9f6ed-8f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG os_vif [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:35:58,bridge_name='br-int',has_traffic_filtering=True,id=22b9f6ed-8f52-4a52-84e9-098f874d5682,network=Network(a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b9f6ed-8f') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22b9f6ed-8f, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22b9f6ed-8f, col_values=(('external_ids', {'iface-id': '22b9f6ed-8f52-4a52-84e9-098f874d5682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:35:58', 'vm-uuid': 'd437efde-81a8-4be0-b9f8-7a34ee7fea3b'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:30 user nova-compute[70659]: INFO os_vif [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:35:58,bridge_name='br-int',has_traffic_filtering=True,id=22b9f6ed-8f52-4a52-84e9-098f874d5682,network=Network(a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b9f6ed-8f')
Jul 25 16:46:30 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:46:30 user nova-compute[70659]: INFO nova.compute.claims [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Claim successful on node user
Jul 25 16:46:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] No BDM found with device name hda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] No VIF found with MAC fa:16:3e:75:35:58, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Using config drive
Jul 25 16:46:30 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:46:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Creating config drive at /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.config
Jul 25 16:46:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp02uc_2q2 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp02uc_2q2" returned: 0 in 0.078s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:46:30 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:46:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 25 16:46:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG nova.policy [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2003d8d874854bc4acb422289d1526a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaea2e7f1fd4577a680fa3bcd9fd889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:46:31 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Creating image(s)
Jul 25 16:46:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "/opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "/opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "96efd85d888162a0513c1f3b3ef112e6c25bae6f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "96efd85d888162a0513c1f3b3ef112e6c25bae6f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG nova.network.neutron [req-9ab4ff02-579f-4075-8f33-22141cc4bab8 req-ea796845-525e-41da-a9df-2e302106175a service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updated VIF entry in instance network info cache for port 22b9f6ed-8f52-4a52-84e9-098f874d5682. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG nova.network.neutron [req-9ab4ff02-579f-4075-8f33-22141cc4bab8 req-ea796845-525e-41da-a9df-2e302106175a service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updating instance_info_cache with network_info: [{"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9ab4ff02-579f-4075-8f33-22141cc4bab8 req-ea796845-525e-41da-a9df-2e302106175a service nova] Releasing lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f.part --force-share --output=json" returned: 0 in 0.248s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG nova.virt.images [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] 123cd06a-9f8f-4ae8-8713-6be1bae433cd was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 16:46:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f.part /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f.part /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f.converted" returned: 0 in 0.198s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Successfully created port: b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f.converted --force-share --output=json" returned: 0 in 0.295s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "96efd85d888162a0513c1f3b3ef112e6c25bae6f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.327s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f --force-share --output=json" returned: 0 in 0.170s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "96efd85d888162a0513c1f3b3ef112e6c25bae6f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "96efd85d888162a0513c1f3b3ef112e6c25bae6f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd84405e-a1d3-459b-8634-f404b864b21c req-913ee744-4d48-46f5-a5c9-a014be611a88 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-plugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd84405e-a1d3-459b-8634-f404b864b21c req-913ee744-4d48-46f5-a5c9-a014be611a88 service nova] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd84405e-a1d3-459b-8634-f404b864b21c req-913ee744-4d48-46f5-a5c9-a014be611a88 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd84405e-a1d3-459b-8634-f404b864b21c req-913ee744-4d48-46f5-a5c9-a014be611a88 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd84405e-a1d3-459b-8634-f404b864b21c req-913ee744-4d48-46f5-a5c9-a014be611a88 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] No waiting events found dispatching network-vif-plugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:32 user nova-compute[70659]: WARNING nova.compute.manager [req-bd84405e-a1d3-459b-8634-f404b864b21c req-913ee744-4d48-46f5-a5c9-a014be611a88 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received unexpected event network-vif-plugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 for instance with vm_state building and task_state spawning.
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f --force-share --output=json" returned: 0 in 0.243s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f,backing_fmt=raw /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f,backing_fmt=raw /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk 1073741824" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "96efd85d888162a0513c1f3b3ef112e6c25bae6f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f --force-share --output=json" returned: 0 in 0.246s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Cannot resize image /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lazy-loading 'migration_context' on Instance uuid 7d47d257-3a12-48d8-bdb1-adec83869c41 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Ensure instance console log exists: /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Successfully updated port: b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "refresh_cache-7d47d257-3a12-48d8-bdb1-adec83869c41" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquired lock "refresh_cache-7d47d257-3a12-48d8-bdb1-adec83869c41" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.compute.manager [req-fa6cab6e-6137-475d-bd2c-450f08407e8b req-85a2895b-4965-4d63-a890-5715be4773dd service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received event network-changed-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.compute.manager [req-fa6cab6e-6137-475d-bd2c-450f08407e8b req-85a2895b-4965-4d63-a890-5715be4773dd service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Refreshing instance network info cache due to event network-changed-b6b068df-7e92-4f25-b964-6c3492bcd6ec. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fa6cab6e-6137-475d-bd2c-450f08407e8b req-85a2895b-4965-4d63-a890-5715be4773dd service nova] Acquiring lock "refresh_cache-7d47d257-3a12-48d8-bdb1-adec83869c41" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:46:34 user nova-compute[70659]: INFO nova.compute.claims [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Claim successful on node user
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Updating instance_info_cache with network_info: [{"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Releasing lock "refresh_cache-7d47d257-3a12-48d8-bdb1-adec83869c41" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Instance network_info: |[{"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fa6cab6e-6137-475d-bd2c-450f08407e8b req-85a2895b-4965-4d63-a890-5715be4773dd service nova] Acquired lock "refresh_cache-7d47d257-3a12-48d8-bdb1-adec83869c41" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.network.neutron [req-fa6cab6e-6137-475d-bd2c-450f08407e8b req-85a2895b-4965-4d63-a890-5715be4773dd service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Refreshing network info cache for port b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Start _get_guest_xml network_info=[{"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:46:19Z,direct_url=<?>,disk_format='qcow2',id=123cd06a-9f8f-4ae8-8713-6be1bae433cd,min_disk=0,min_ram=0,name='',owner='d6abb22e5ced48c8be0c42a6c37d61e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:46:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': '123cd06a-9f8f-4ae8-8713-6be1bae433cd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:46:34 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:34 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:46:19Z,direct_url=<?>,disk_format='qcow2',id=123cd06a-9f8f-4ae8-8713-6be1bae433cd,min_disk=0,min_ram=0,name='',owner='d6abb22e5ced48c8be0c42a6c37d61e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:46:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-232816778',display_name='tempest-AttachSCSIVolumeTestJSON-server-232816778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-232816778',id=9,image_ref='123cd06a-9f8f-4ae8-8713-6be1bae433cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoSG4GQbe1LcW30OGqdpCrzqKywM7PlMIzqAylE6JjeJfC10mddixfpctd5ROj9yvfXJFjmpfySWnd56nxNYPvUHo4ZW3hC1n6XnpF6C7mihQ4aLmoNr+MsbtWglRiL/w==',key_name='tempest-keypair-2070017815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdaea2e7f1fd4577a680fa3bcd9fd889',ramdisk_id='',reservation_id='r-48tjw644',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='123cd06a-9f8f-4ae8-8713-6be1bae433cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-732415869',owner_user_name='tempest-AttachSCSIVolumeTestJSON-732415869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2003d8d874854bc4acb422289d1526a3',uuid=7d47d257-3a12-48d8-bdb1-adec83869c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Converting VIF {"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:92:1e,bridge_name='br-int',has_traffic_filtering=True,id=b6b068df-7e92-4f25-b964-6c3492bcd6ec,network=Network(12745182-c92e-41f1-9e11-5f811fadb16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6b068df-7e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d47d257-3a12-48d8-bdb1-adec83869c41 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:46:34 user nova-compute[70659]:   <uuid>7d47d257-3a12-48d8-bdb1-adec83869c41</uuid>
Jul 25 16:46:34 user nova-compute[70659]:   <name>instance-00000009</name>
Jul 25 16:46:34 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:46:34 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:46:34 user nova-compute[70659]:   <metadata>
Jul 25 16:46:34 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:46:34 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:46:34 user nova-compute[70659]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-232816778</nova:name>
Jul 25 16:46:34 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:46:34</nova:creationTime>
Jul 25 16:46:34 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:46:34 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:46:34 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:46:34 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:46:34 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:46:34 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:46:34 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:46:34 user nova-compute[70659]:       <nova:owner>
Jul 25 16:46:34 user nova-compute[70659]:         <nova:user uuid="2003d8d874854bc4acb422289d1526a3">tempest-AttachSCSIVolumeTestJSON-732415869-project-member</nova:user>
Jul 25 16:46:34 user nova-compute[70659]:         <nova:project uuid="bdaea2e7f1fd4577a680fa3bcd9fd889">tempest-AttachSCSIVolumeTestJSON-732415869</nova:project>
Jul 25 16:46:34 user nova-compute[70659]:       </nova:owner>
Jul 25 16:46:34 user nova-compute[70659]:       <nova:root type="image" uuid="123cd06a-9f8f-4ae8-8713-6be1bae433cd"/>
Jul 25 16:46:34 user nova-compute[70659]:       <nova:ports>
Jul 25 16:46:34 user nova-compute[70659]:         <nova:port uuid="b6b068df-7e92-4f25-b964-6c3492bcd6ec">
Jul 25 16:46:34 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 16:46:34 user nova-compute[70659]:         </nova:port>
Jul 25 16:46:34 user nova-compute[70659]:       </nova:ports>
Jul 25 16:46:34 user nova-compute[70659]:     </nova:instance>
Jul 25 16:46:34 user nova-compute[70659]:   </metadata>
Jul 25 16:46:34 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:46:34 user nova-compute[70659]:     <system>
Jul 25 16:46:34 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:46:34 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:46:34 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:46:34 user nova-compute[70659]:       <entry name="serial">7d47d257-3a12-48d8-bdb1-adec83869c41</entry>
Jul 25 16:46:34 user nova-compute[70659]:       <entry name="uuid">7d47d257-3a12-48d8-bdb1-adec83869c41</entry>
Jul 25 16:46:34 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:46:34 user nova-compute[70659]:     </system>
Jul 25 16:46:34 user nova-compute[70659]:   </sysinfo>
Jul 25 16:46:34 user nova-compute[70659]:   <os>
Jul 25 16:46:34 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:46:34 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:46:34 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:46:34 user nova-compute[70659]:   </os>
Jul 25 16:46:34 user nova-compute[70659]:   <features>
Jul 25 16:46:34 user nova-compute[70659]:     <acpi/>
Jul 25 16:46:34 user nova-compute[70659]:     <apic/>
Jul 25 16:46:34 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:46:34 user nova-compute[70659]:   </features>
Jul 25 16:46:34 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:46:34 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:46:34 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:46:34 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:46:34 user nova-compute[70659]:   </clock>
Jul 25 16:46:34 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:46:34 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:46:34 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:46:34 user nova-compute[70659]:   </cpu>
Jul 25 16:46:34 user nova-compute[70659]:   <devices>
Jul 25 16:46:34 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:46:34 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:46:34 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk"/>
Jul 25 16:46:34 user nova-compute[70659]:       <target dev="sda" bus="scsi"/>
Jul 25 16:46:34 user nova-compute[70659]:       <address type="drive" controller="0" unit="0"/>
Jul 25 16:46:34 user nova-compute[70659]:     </disk>
Jul 25 16:46:34 user nova-compute[70659]:     <disk type="file" device="cdrom">
Jul 25 16:46:34 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 16:46:34 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk.config"/>
Jul 25 16:46:34 user nova-compute[70659]:       <target dev="sdb" bus="scsi"/>
Jul 25 16:46:34 user nova-compute[70659]:       <address type="drive" controller="0" unit="1"/>
Jul 25 16:46:34 user nova-compute[70659]:     </disk>
Jul 25 16:46:34 user nova-compute[70659]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 25 16:46:34 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:46:34 user nova-compute[70659]:       <mac address="fa:16:3e:57:92:1e"/>
Jul 25 16:46:34 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:34 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:46:34 user nova-compute[70659]:       <target dev="tapb6b068df-7e"/>
Jul 25 16:46:34 user nova-compute[70659]:     </interface>
Jul 25 16:46:34 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:46:34 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/console.log" append="off"/>
Jul 25 16:46:34 user nova-compute[70659]:     </serial>
Jul 25 16:46:34 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:46:34 user nova-compute[70659]:     <video>
Jul 25 16:46:34 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:34 user nova-compute[70659]:     </video>
Jul 25 16:46:34 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:46:34 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:46:34 user nova-compute[70659]:     </rng>
Jul 25 16:46:34 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:46:34 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:46:34 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:46:34 user nova-compute[70659]:     </memballoon>
Jul 25 16:46:34 user nova-compute[70659]:   </devices>
Jul 25 16:46:34 user nova-compute[70659]: </domain>
Jul 25 16:46:34 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-232816778',display_name='tempest-AttachSCSIVolumeTestJSON-server-232816778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-232816778',id=9,image_ref='123cd06a-9f8f-4ae8-8713-6be1bae433cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoSG4GQbe1LcW30OGqdpCrzqKywM7PlMIzqAylE6JjeJfC10mddixfpctd5ROj9yvfXJFjmpfySWnd56nxNYPvUHo4ZW3hC1n6XnpF6C7mihQ4aLmoNr+MsbtWglRiL/w==',key_name='tempest-keypair-2070017815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdaea2e7f1fd4577a680fa3bcd9fd889',ramdisk_id='',reservation_id='r-48tjw644',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='123cd06a-9f8f-4ae8-8713-6be1bae433cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-732415869',owner_user_name='tempest-AttachSCSIVolumeTestJSON-732415869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2003d8d874854bc4acb422289d1526a3',uuid=7d47d257-3a12-48d8-bdb1-adec83869c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Converting VIF {"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:92:1e,bridge_name='br-int',has_traffic_filtering=True,id=b6b068df-7e92-4f25-b964-6c3492bcd6ec,network=Network(12745182-c92e-41f1-9e11-5f811fadb16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6b068df-7e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG os_vif [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:92:1e,bridge_name='br-int',has_traffic_filtering=True,id=b6b068df-7e92-4f25-b964-6c3492bcd6ec,network=Network(12745182-c92e-41f1-9e11-5f811fadb16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6b068df-7e') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6b068df-7e, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6b068df-7e, col_values=(('external_ids', {'iface-id': 'b6b068df-7e92-4f25-b964-6c3492bcd6ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:92:1e', 'vm-uuid': '7d47d257-3a12-48d8-bdb1-adec83869c41'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:34 user nova-compute[70659]: INFO os_vif [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:92:1e,bridge_name='br-int',has_traffic_filtering=True,id=b6b068df-7e92-4f25-b964-6c3492bcd6ec,network=Network(12745182-c92e-41f1-9e11-5f811fadb16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6b068df-7e')
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] No BDM found with device name sda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] No VIF found with MAC fa:16:3e:57:92:1e, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:34 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Using config drive
Jul 25 16:46:34 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Creating config drive at /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk.config
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptntv1bgr {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptntv1bgr" returned: 0 in 0.111s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.874s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-20e290e9-7c93-4b63-8041-58a2a0d00f87 req-f3e77151-9d3e-404d-be61-f68761e6f155 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-plugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20e290e9-7c93-4b63-8041-58a2a0d00f87 req-f3e77151-9d3e-404d-be61-f68761e6f155 service nova] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20e290e9-7c93-4b63-8041-58a2a0d00f87 req-f3e77151-9d3e-404d-be61-f68761e6f155 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20e290e9-7c93-4b63-8041-58a2a0d00f87 req-f3e77151-9d3e-404d-be61-f68761e6f155 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-20e290e9-7c93-4b63-8041-58a2a0d00f87 req-f3e77151-9d3e-404d-be61-f68761e6f155 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] No waiting events found dispatching network-vif-plugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:34 user nova-compute[70659]: WARNING nova.compute.manager [req-20e290e9-7c93-4b63-8041-58a2a0d00f87 req-f3e77151-9d3e-404d-be61-f68761e6f155 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received unexpected event network-vif-plugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 for instance with vm_state building and task_state spawning.
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:46:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:46:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303595.0866072, d437efde-81a8-4be0-b9f8-7a34ee7fea3b => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:35 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] VM Resumed (Lifecycle Event)
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.policy [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b454e0356d247259a4f6c58aa18c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c8d9889d484385a4e5e2140d7134ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:46:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Instance spawned successfully.
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.network.neutron [req-fa6cab6e-6137-475d-bd2c-450f08407e8b req-85a2895b-4965-4d63-a890-5715be4773dd service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Updated VIF entry in instance network info cache for port b6b068df-7e92-4f25-b964-6c3492bcd6ec. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.network.neutron [req-fa6cab6e-6137-475d-bd2c-450f08407e8b req-85a2895b-4965-4d63-a890-5715be4773dd service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Updating instance_info_cache with network_info: [{"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:35 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303595.1019802, d437efde-81a8-4be0-b9f8-7a34ee7fea3b => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:35 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] VM Started (Lifecycle Event)
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fa6cab6e-6137-475d-bd2c-450f08407e8b req-85a2895b-4965-4d63-a890-5715be4773dd service nova] Releasing lock "refresh_cache-7d47d257-3a12-48d8-bdb1-adec83869c41" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:35 user nova-compute[70659]: INFO nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Took 11.52 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:46:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Creating image(s)
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "/opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "/opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "/opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:35 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:35 user nova-compute[70659]: INFO nova.compute.manager [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Took 13.19 seconds to build instance.
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-97d524a8-2887-4b6b-8033-70553d4f9d75 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.478s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk 1073741824" returned: 0 in 0.061s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:46:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Successfully created port: e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Cannot resize image /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG nova.objects.instance [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lazy-loading 'migration_context' on Instance uuid 98c0757f-7146-48ea-ac36-e7c107e74d73 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Ensure instance console log exists: /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-79e2e995-e4cf-4264-b622-389889dbdd4f req-fc7824f3-baf2-4644-9251-51471d961831 service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received event network-vif-plugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-79e2e995-e4cf-4264-b622-389889dbdd4f req-fc7824f3-baf2-4644-9251-51471d961831 service nova] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-79e2e995-e4cf-4264-b622-389889dbdd4f req-fc7824f3-baf2-4644-9251-51471d961831 service nova] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-79e2e995-e4cf-4264-b622-389889dbdd4f req-fc7824f3-baf2-4644-9251-51471d961831 service nova] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-79e2e995-e4cf-4264-b622-389889dbdd4f req-fc7824f3-baf2-4644-9251-51471d961831 service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] No waiting events found dispatching network-vif-plugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:36 user nova-compute[70659]: WARNING nova.compute.manager [req-79e2e995-e4cf-4264-b622-389889dbdd4f req-fc7824f3-baf2-4644-9251-51471d961831 service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received unexpected event network-vif-plugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec for instance with vm_state building and task_state spawning.
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Successfully updated port: e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "refresh_cache-98c0757f-7146-48ea-ac36-e7c107e74d73" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquired lock "refresh_cache-98c0757f-7146-48ea-ac36-e7c107e74d73" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-effc9459-77ee-4ccf-ac74-0a15e56c3f9b req-9abec2e5-d542-4e02-85ff-b0a4c5f663e4 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received event network-changed-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-effc9459-77ee-4ccf-ac74-0a15e56c3f9b req-9abec2e5-d542-4e02-85ff-b0a4c5f663e4 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Refreshing instance network info cache due to event network-changed-e09bb48a-aed2-4377-9b1b-cfbd077068ec. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-effc9459-77ee-4ccf-ac74-0a15e56c3f9b req-9abec2e5-d542-4e02-85ff-b0a4c5f663e4 service nova] Acquiring lock "refresh_cache-98c0757f-7146-48ea-ac36-e7c107e74d73" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Updating instance_info_cache with network_info: [{"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Releasing lock "refresh_cache-98c0757f-7146-48ea-ac36-e7c107e74d73" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Instance network_info: |[{"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-effc9459-77ee-4ccf-ac74-0a15e56c3f9b req-9abec2e5-d542-4e02-85ff-b0a4c5f663e4 service nova] Acquired lock "refresh_cache-98c0757f-7146-48ea-ac36-e7c107e74d73" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-effc9459-77ee-4ccf-ac74-0a15e56c3f9b req-9abec2e5-d542-4e02-85ff-b0a4c5f663e4 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Refreshing network info cache for port e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Start _get_guest_xml network_info=[{"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:46:37 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:37 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1873556572',display_name='tempest-TestVolumeSwap-server-1873556572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1873556572',id=10,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoGemF4reNituil1ug3LIAXgVx78D+iciifOQhindLjWetP2/lFnSNYyXxaPAZQEGhi4fXO7qeTXdiRiGeU0koi/7ws3txCj4pxJtyRoOFQtZJMbo+nkHeJ4NY8NC+pFg==',key_name='tempest-keypair-637778745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76c8d9889d484385a4e5e2140d7134ff',ramdisk_id='',reservation_id='r-ipubf96l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1956469207',owner_user_name='tempest-TestVolumeSwap-1956469207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b454e0356d247259a4f6c58aa18c6eb',uuid=98c0757f-7146-48ea-ac36-e7c107e74d73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Converting VIF {"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:02:a4,bridge_name='br-int',has_traffic_filtering=True,id=e09bb48a-aed2-4377-9b1b-cfbd077068ec,network=Network(89bdacca-5cda-4182-a752-a05d38815546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09bb48a-ae') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.objects.instance [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lazy-loading 'pci_devices' on Instance uuid 98c0757f-7146-48ea-ac36-e7c107e74d73 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:46:37 user nova-compute[70659]:   <uuid>98c0757f-7146-48ea-ac36-e7c107e74d73</uuid>
Jul 25 16:46:37 user nova-compute[70659]:   <name>instance-0000000a</name>
Jul 25 16:46:37 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:46:37 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:46:37 user nova-compute[70659]:   <metadata>
Jul 25 16:46:37 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:46:37 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:46:37 user nova-compute[70659]:       <nova:name>tempest-TestVolumeSwap-server-1873556572</nova:name>
Jul 25 16:46:37 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:46:37</nova:creationTime>
Jul 25 16:46:37 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:46:37 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:46:37 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:46:37 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:46:37 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:46:37 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:46:37 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:46:37 user nova-compute[70659]:       <nova:owner>
Jul 25 16:46:37 user nova-compute[70659]:         <nova:user uuid="8b454e0356d247259a4f6c58aa18c6eb">tempest-TestVolumeSwap-1956469207-project-member</nova:user>
Jul 25 16:46:37 user nova-compute[70659]:         <nova:project uuid="76c8d9889d484385a4e5e2140d7134ff">tempest-TestVolumeSwap-1956469207</nova:project>
Jul 25 16:46:37 user nova-compute[70659]:       </nova:owner>
Jul 25 16:46:37 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:46:37 user nova-compute[70659]:       <nova:ports>
Jul 25 16:46:37 user nova-compute[70659]:         <nova:port uuid="e09bb48a-aed2-4377-9b1b-cfbd077068ec">
Jul 25 16:46:37 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 16:46:37 user nova-compute[70659]:         </nova:port>
Jul 25 16:46:37 user nova-compute[70659]:       </nova:ports>
Jul 25 16:46:37 user nova-compute[70659]:     </nova:instance>
Jul 25 16:46:37 user nova-compute[70659]:   </metadata>
Jul 25 16:46:37 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:46:37 user nova-compute[70659]:     <system>
Jul 25 16:46:37 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:46:37 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:46:37 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:46:37 user nova-compute[70659]:       <entry name="serial">98c0757f-7146-48ea-ac36-e7c107e74d73</entry>
Jul 25 16:46:37 user nova-compute[70659]:       <entry name="uuid">98c0757f-7146-48ea-ac36-e7c107e74d73</entry>
Jul 25 16:46:37 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:46:37 user nova-compute[70659]:     </system>
Jul 25 16:46:37 user nova-compute[70659]:   </sysinfo>
Jul 25 16:46:37 user nova-compute[70659]:   <os>
Jul 25 16:46:37 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:46:37 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:46:37 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:46:37 user nova-compute[70659]:   </os>
Jul 25 16:46:37 user nova-compute[70659]:   <features>
Jul 25 16:46:37 user nova-compute[70659]:     <acpi/>
Jul 25 16:46:37 user nova-compute[70659]:     <apic/>
Jul 25 16:46:37 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:46:37 user nova-compute[70659]:   </features>
Jul 25 16:46:37 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:46:37 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:46:37 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:46:37 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:46:37 user nova-compute[70659]:   </clock>
Jul 25 16:46:37 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:46:37 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:46:37 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:46:37 user nova-compute[70659]:   </cpu>
Jul 25 16:46:37 user nova-compute[70659]:   <devices>
Jul 25 16:46:37 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:46:37 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:46:37 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk"/>
Jul 25 16:46:37 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:46:37 user nova-compute[70659]:     </disk>
Jul 25 16:46:37 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:46:37 user nova-compute[70659]:       <mac address="fa:16:3e:bd:02:a4"/>
Jul 25 16:46:37 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:37 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:46:37 user nova-compute[70659]:       <target dev="tape09bb48a-ae"/>
Jul 25 16:46:37 user nova-compute[70659]:     </interface>
Jul 25 16:46:37 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:46:37 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/console.log" append="off"/>
Jul 25 16:46:37 user nova-compute[70659]:     </serial>
Jul 25 16:46:37 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:46:37 user nova-compute[70659]:     <video>
Jul 25 16:46:37 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:46:37 user nova-compute[70659]:     </video>
Jul 25 16:46:37 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:46:37 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:46:37 user nova-compute[70659]:     </rng>
Jul 25 16:46:37 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:46:37 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:46:37 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:46:37 user nova-compute[70659]:     </memballoon>
Jul 25 16:46:37 user nova-compute[70659]:   </devices>
Jul 25 16:46:37 user nova-compute[70659]: </domain>
Jul 25 16:46:37 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1873556572',display_name='tempest-TestVolumeSwap-server-1873556572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1873556572',id=10,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoGemF4reNituil1ug3LIAXgVx78D+iciifOQhindLjWetP2/lFnSNYyXxaPAZQEGhi4fXO7qeTXdiRiGeU0koi/7ws3txCj4pxJtyRoOFQtZJMbo+nkHeJ4NY8NC+pFg==',key_name='tempest-keypair-637778745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76c8d9889d484385a4e5e2140d7134ff',ramdisk_id='',reservation_id='r-ipubf96l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1956469207',owner_user_name='tempest-TestVolumeSwap-1956469207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b454e0356d247259a4f6c58aa18c6eb',uuid=98c0757f-7146-48ea-ac36-e7c107e74d73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Converting VIF {"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:02:a4,bridge_name='br-int',has_traffic_filtering=True,id=e09bb48a-aed2-4377-9b1b-cfbd077068ec,network=Network(89bdacca-5cda-4182-a752-a05d38815546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09bb48a-ae') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG os_vif [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:02:a4,bridge_name='br-int',has_traffic_filtering=True,id=e09bb48a-aed2-4377-9b1b-cfbd077068ec,network=Network(89bdacca-5cda-4182-a752-a05d38815546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09bb48a-ae') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape09bb48a-ae, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape09bb48a-ae, col_values=(('external_ids', {'iface-id': 'e09bb48a-aed2-4377-9b1b-cfbd077068ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:02:a4', 'vm-uuid': '98c0757f-7146-48ea-ac36-e7c107e74d73'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:37 user nova-compute[70659]: INFO os_vif [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:02:a4,bridge_name='br-int',has_traffic_filtering=True,id=e09bb48a-aed2-4377-9b1b-cfbd077068ec,network=Network(89bdacca-5cda-4182-a752-a05d38815546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09bb48a-ae')
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:46:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] No VIF found with MAC fa:16:3e:bd:02:a4, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-effc9459-77ee-4ccf-ac74-0a15e56c3f9b req-9abec2e5-d542-4e02-85ff-b0a4c5f663e4 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Updated VIF entry in instance network info cache for port e09bb48a-aed2-4377-9b1b-cfbd077068ec. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-effc9459-77ee-4ccf-ac74-0a15e56c3f9b req-9abec2e5-d542-4e02-85ff-b0a4c5f663e4 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Updating instance_info_cache with network_info: [{"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-effc9459-77ee-4ccf-ac74-0a15e56c3f9b req-9abec2e5-d542-4e02-85ff-b0a4c5f663e4 service nova] Releasing lock "refresh_cache-98c0757f-7146-48ea-ac36-e7c107e74d73" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-d46040c3-f009-48fd-9294-513e9849c481 req-752b438e-021c-45e6-9047-dd7c92327586 service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received event network-vif-plugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d46040c3-f009-48fd-9294-513e9849c481 req-752b438e-021c-45e6-9047-dd7c92327586 service nova] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d46040c3-f009-48fd-9294-513e9849c481 req-752b438e-021c-45e6-9047-dd7c92327586 service nova] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d46040c3-f009-48fd-9294-513e9849c481 req-752b438e-021c-45e6-9047-dd7c92327586 service nova] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-d46040c3-f009-48fd-9294-513e9849c481 req-752b438e-021c-45e6-9047-dd7c92327586 service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] No waiting events found dispatching network-vif-plugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:38 user nova-compute[70659]: WARNING nova.compute.manager [req-d46040c3-f009-48fd-9294-513e9849c481 req-752b438e-021c-45e6-9047-dd7c92327586 service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received unexpected event network-vif-plugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec for instance with vm_state building and task_state spawning.
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303598.8325837, 7d47d257-3a12-48d8-bdb1-adec83869c41 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] VM Resumed (Lifecycle Event)
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Instance spawned successfully.
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303598.8335721, 7d47d257-3a12-48d8-bdb1-adec83869c41 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] VM Started (Lifecycle Event)
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:38 user nova-compute[70659]: INFO nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Took 7.79 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:39 user nova-compute[70659]: INFO nova.compute.manager [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Took 9.08 seconds to build instance.
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d6854203-e459-4e83-9c5a-7b832cabdfbd tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.203s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-057f4ce8-4813-43d5-9c36-7d19994920a6 req-4b1d3e33-538a-4b68-a0ed-3d111f52db1b service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received event network-vif-plugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-057f4ce8-4813-43d5-9c36-7d19994920a6 req-4b1d3e33-538a-4b68-a0ed-3d111f52db1b service nova] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-057f4ce8-4813-43d5-9c36-7d19994920a6 req-4b1d3e33-538a-4b68-a0ed-3d111f52db1b service nova] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-057f4ce8-4813-43d5-9c36-7d19994920a6 req-4b1d3e33-538a-4b68-a0ed-3d111f52db1b service nova] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-057f4ce8-4813-43d5-9c36-7d19994920a6 req-4b1d3e33-538a-4b68-a0ed-3d111f52db1b service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] No waiting events found dispatching network-vif-plugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:39 user nova-compute[70659]: WARNING nova.compute.manager [req-057f4ce8-4813-43d5-9c36-7d19994920a6 req-4b1d3e33-538a-4b68-a0ed-3d111f52db1b service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received unexpected event network-vif-plugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec for instance with vm_state building and task_state spawning.
Jul 25 16:46:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-bbedc91b-e4ca-44e4-ac58-bd23bb39b0db req-798d44cd-5cdf-4058-88a8-a395ae39bce3 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received event network-vif-plugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bbedc91b-e4ca-44e4-ac58-bd23bb39b0db req-798d44cd-5cdf-4058-88a8-a395ae39bce3 service nova] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bbedc91b-e4ca-44e4-ac58-bd23bb39b0db req-798d44cd-5cdf-4058-88a8-a395ae39bce3 service nova] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bbedc91b-e4ca-44e4-ac58-bd23bb39b0db req-798d44cd-5cdf-4058-88a8-a395ae39bce3 service nova] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-bbedc91b-e4ca-44e4-ac58-bd23bb39b0db req-798d44cd-5cdf-4058-88a8-a395ae39bce3 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] No waiting events found dispatching network-vif-plugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:46:41 user nova-compute[70659]: WARNING nova.compute.manager [req-bbedc91b-e4ca-44e4-ac58-bd23bb39b0db req-798d44cd-5cdf-4058-88a8-a395ae39bce3 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received unexpected event network-vif-plugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec for instance with vm_state building and task_state spawning.
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303601.7646785, 98c0757f-7146-48ea-ac36-e7c107e74d73 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:41 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] VM Resumed (Lifecycle Event)
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:46:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Instance spawned successfully.
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:41 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303601.7653122, 98c0757f-7146-48ea-ac36-e7c107e74d73 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:46:41 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] VM Started (Lifecycle Event)
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:46:42 user nova-compute[70659]: INFO nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Took 6.65 seconds to spawn the instance on the hypervisor.
Jul 25 16:46:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:46:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:42 user nova-compute[70659]: INFO nova.compute.manager [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Took 8.18 seconds to build instance.
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-53ab36cd-dfa6-414b-9bea-51a49f55fa86 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.341s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:46:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:46:44 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:44 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7287MB free_disk=25.673145294189453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c9728d00-f454-4616-af0b-8cfd0f012cad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 7d47d257-3a12-48d8-bdb1-adec83869c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 98c0757f-7146-48ea-ac36-e7c107e74d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:46:44 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:46:45 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:46:45 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:46:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:46:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:46:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updating instance_info_cache with network_info: [{"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:46:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:46:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:46:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:47:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:47:09 user nova-compute[70659]: INFO nova.compute.claims [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Claim successful on node user
Jul 25 16:47:09 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 16:47:09 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 16:47:09 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 16:47:10 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 16:47:10 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 16:47:10 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:47:10 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:47:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:47:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:47:10 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:47:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:47:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:47:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:10 user nova-compute[70659]: INFO nova.virt.block_device [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Booting with volume 9b06b74c-55d9-4002-8dc4-1614fcad7233 at /dev/vda
Jul 25 16:47:10 user nova-compute[70659]: DEBUG os_brick.utils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:10 user nova-compute[70659]: INFO oslo.privsep.daemon [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3p07a5uh/privsep.sock']
Jul 25 16:47:10 user nova-compute[70659]: DEBUG nova.policy [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5e52d7ac7064f41977498f4d771169c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb6ec6679fa44c4934e4bb8a6478920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:47:10 user sudo[81805]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3p07a5uh/privsep.sock
Jul 25 16:47:10 user sudo[81805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 25 16:47:11 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully created port: a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully created port: 56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:12 user sudo[81805]: pam_unix(sudo:session): session closed for user root
Jul 25 16:47:12 user nova-compute[70659]: INFO oslo.privsep.daemon [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Spawned new privsep daemon via rootwrap
Jul 25 16:47:12 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 25 16:47:12 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 25 16:47:12 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 25 16:47:12 user nova-compute[70659]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81811
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72a93d0-0fb6-4bd9-b1ae-c3c91c16cb85]: (2,) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a234d56-e087-4c09-8a92-5176b5d825f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:12 user nova-compute[70659]: WARNING os_brick.initiator.connectors.nvmeof [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb17cdea-ebb5-4fd3-b807-203ed4b08365]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04542ac-86dc-43e6-b5d8-e34074231ca6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d046a13-a95d-40a9-ab7e-ba8efa6a065a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:13 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:47:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[605256cc-1a8e-428e-8962-80ccf6d1ffb6]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG os_brick.utils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] <== get_connector_properties: return (2236ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating existing volume attachment record: 4bb36167-d858-4788-95ae-99ed827a6d33 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully created port: 7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully created port: 073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:47:13 user nova-compute[70659]: INFO nova.compute.claims [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Claim successful on node user
Jul 25 16:47:14 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully created port: a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:47:14 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:47:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:47:14 user nova-compute[70659]: INFO nova.virt.block_device [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Booting with volume b7f44b4d-b14d-4f3f-a012-1fb73e1f805e at /dev/vda
Jul 25 16:47:14 user nova-compute[70659]: DEBUG os_brick.utils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG nova.policy [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83ffbc9e4ab54d1a98a0bdfddb7b9868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e568f9df34d918c1684e2e93ad659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2dd8d2-8f7f-4a05-91f7-8b0d0e1337c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44982d0-f23a-4807-8fe7-4cbaeefe3132]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c4c94a-e39f-4e48-8a2d-97c99bd8bea5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da9be06-d64b-4a7e-9240-2c4ced69f225]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:14 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:47:14 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[94760ac5-3913-4a8e-a624-654324d03985]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG os_brick.utils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:14 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating existing volume attachment record: 2131c7e7-117f-4733-9626-8dd4cec4d3d7 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully updated port: a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-8cb53927-c41e-4704-8f7c-38518dab3c36 req-e613a976-6a6f-494f-a5e5-12dced66eaae service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-changed-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-8cb53927-c41e-4704-8f7c-38518dab3c36 req-e613a976-6a6f-494f-a5e5-12dced66eaae service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing instance network info cache due to event network-changed-a91425c6-074b-45e1-8529-fbc20abbeeb1. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8cb53927-c41e-4704-8f7c-38518dab3c36 req-e613a976-6a6f-494f-a5e5-12dced66eaae service nova] Acquiring lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8cb53927-c41e-4704-8f7c-38518dab3c36 req-e613a976-6a6f-494f-a5e5-12dced66eaae service nova] Acquired lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-8cb53927-c41e-4704-8f7c-38518dab3c36 req-e613a976-6a6f-494f-a5e5-12dced66eaae service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing network info cache for port a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-8cb53927-c41e-4704-8f7c-38518dab3c36 req-e613a976-6a6f-494f-a5e5-12dced66eaae service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully created port: a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:15 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully created port: 15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-8cb53927-c41e-4704-8f7c-38518dab3c36 req-e613a976-6a6f-494f-a5e5-12dced66eaae service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8cb53927-c41e-4704-8f7c-38518dab3c36 req-e613a976-6a6f-494f-a5e5-12dced66eaae service nova] Releasing lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:16 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully created port: 0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:16 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully updated port: 8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-184d90b4-b116-46a9-bb16-2d2371ec691d req-1857c9f9-46ad-4034-933a-175e0ac8acd3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-changed-8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-184d90b4-b116-46a9-bb16-2d2371ec691d req-1857c9f9-46ad-4034-933a-175e0ac8acd3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing instance network info cache due to event network-changed-8307269f-4c27-4543-9d41-e39fc9e555d6. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-184d90b4-b116-46a9-bb16-2d2371ec691d req-1857c9f9-46ad-4034-933a-175e0ac8acd3 service nova] Acquiring lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-184d90b4-b116-46a9-bb16-2d2371ec691d req-1857c9f9-46ad-4034-933a-175e0ac8acd3 service nova] Acquired lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-184d90b4-b116-46a9-bb16-2d2371ec691d req-1857c9f9-46ad-4034-933a-175e0ac8acd3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing network info cache for port 8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-184d90b4-b116-46a9-bb16-2d2371ec691d req-1857c9f9-46ad-4034-933a-175e0ac8acd3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully created port: 2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully updated port: 626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-184d90b4-b116-46a9-bb16-2d2371ec691d req-1857c9f9-46ad-4034-933a-175e0ac8acd3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-184d90b4-b116-46a9-bb16-2d2371ec691d req-1857c9f9-46ad-4034-933a-175e0ac8acd3 service nova] Releasing lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully created port: a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:47:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully updated port: 56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully updated port: a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-e871b99d-3064-47f8-873e-38cf17fd8843 req-64e55aef-0ee4-4298-bc94-f9c5facefc00 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-changed-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-e871b99d-3064-47f8-873e-38cf17fd8843 req-64e55aef-0ee4-4298-bc94-f9c5facefc00 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing instance network info cache due to event network-changed-a81b2274-5695-4d3e-9543-b8b1f24ab8d9. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e871b99d-3064-47f8-873e-38cf17fd8843 req-64e55aef-0ee4-4298-bc94-f9c5facefc00 service nova] Acquiring lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e871b99d-3064-47f8-873e-38cf17fd8843 req-64e55aef-0ee4-4298-bc94-f9c5facefc00 service nova] Acquired lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-e871b99d-3064-47f8-873e-38cf17fd8843 req-64e55aef-0ee4-4298-bc94-f9c5facefc00 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing network info cache for port a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-e871b99d-3064-47f8-873e-38cf17fd8843 req-64e55aef-0ee4-4298-bc94-f9c5facefc00 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-changed-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing instance network info cache due to event network-changed-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] Acquiring lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] Acquired lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing network info cache for port 626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-e871b99d-3064-47f8-873e-38cf17fd8843 req-64e55aef-0ee4-4298-bc94-f9c5facefc00 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e871b99d-3064-47f8-873e-38cf17fd8843 req-64e55aef-0ee4-4298-bc94-f9c5facefc00 service nova] Releasing lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:19 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully updated port: 7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG nova.network.neutron [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] Releasing lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-changed-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing instance network info cache due to event network-changed-56599ea4-5413-4adb-ab9b-a47b3d5ed020. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] Acquiring lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] Acquired lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG nova.network.neutron [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing network info cache for port 56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG nova.network.neutron [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:20 user nova-compute[70659]: INFO nova.virt.block_device [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Booting with volume 4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 at /dev/vdb
Jul 25 16:47:20 user nova-compute[70659]: DEBUG os_brick.utils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a66b98-7286-4d67-9cf2-88e92484302b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[85da0aa2-cf0c-402f-8458-450eb3ee16e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d460cc-c12a-466f-9a74-119690164248]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06c016d-3961-4f1e-a6a3-511b8c099c50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:20 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[916442b4-5a50-4bee-a291-61bdde588c0b]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG os_brick.utils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating existing volume attachment record: f6a5f3af-a3b9-4a95-980b-697f49abacb7 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully updated port: 3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully updated port: 073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG nova.network.neutron [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-796e51cc-4ddc-4dfa-9477-a95e712917e8 req-eee6c8d2-c526-4bc1-96fe-708d5a88486b service nova] Releasing lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-7436f102-0922-4c9e-902d-51ff83af0a82 req-2a62e2b3-2173-44e1-b4b4-fecf4291ce55 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-changed-3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-7436f102-0922-4c9e-902d-51ff83af0a82 req-2a62e2b3-2173-44e1-b4b4-fecf4291ce55 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing instance network info cache due to event network-changed-3a834d3c-ee6d-4582-bee2-3da76e26cbca. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7436f102-0922-4c9e-902d-51ff83af0a82 req-2a62e2b3-2173-44e1-b4b4-fecf4291ce55 service nova] Acquiring lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7436f102-0922-4c9e-902d-51ff83af0a82 req-2a62e2b3-2173-44e1-b4b4-fecf4291ce55 service nova] Acquired lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-7436f102-0922-4c9e-902d-51ff83af0a82 req-2a62e2b3-2173-44e1-b4b4-fecf4291ce55 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing network info cache for port 3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-7436f102-0922-4c9e-902d-51ff83af0a82 req-2a62e2b3-2173-44e1-b4b4-fecf4291ce55 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-7436f102-0922-4c9e-902d-51ff83af0a82 req-2a62e2b3-2173-44e1-b4b4-fecf4291ce55 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7436f102-0922-4c9e-902d-51ff83af0a82 req-2a62e2b3-2173-44e1-b4b4-fecf4291ce55 service nova] Releasing lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-changed-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing instance network info cache due to event network-changed-7d6092df-2c0e-4f9e-ae16-a8282dc45f03. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] Acquiring lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] Acquired lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing network info cache for port 7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully updated port: ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] Releasing lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-changed-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing instance network info cache due to event network-changed-073a9571-bc46-4f6b-bccd-262a6e05a4c5. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] Acquiring lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] Acquired lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing network info cache for port 073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Successfully updated port: a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:22 user nova-compute[70659]: INFO nova.virt.block_device [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Booting with volume 288bdf65-622e-4e9b-a7cc-d375ced26cb7 at /dev/vdb
Jul 25 16:47:22 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc8d7040-9ccd-4085-9efe-f8750ef8f1a5 req-d02dfaf6-0a63-4f72-ad9f-300aa6f085bf service nova] Releasing lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquired lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG os_brick.utils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c5bad-4f7b-4f57-9af2-02517005d740]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c08258-51b2-49cf-9307-6159fec4c0a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f083536e-da17-415f-b054-4457ab0a0801]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4087b365-5e83-4f5d-bc35-3c07a53c611a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:22 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:47:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41ed524-ce9b-4558-b0cc-d16e173dd035]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG os_brick.utils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating existing volume attachment record: 6fb714de-0eab-493b-821e-22fd09ed013a {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:47:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-1784bad0-db5d-40a4-a0c0-2b7164ea53c9 req-c27d53dd-006e-4fab-b980-06d980623641 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-changed-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-1784bad0-db5d-40a4-a0c0-2b7164ea53c9 req-c27d53dd-006e-4fab-b980-06d980623641 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing instance network info cache due to event network-changed-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1784bad0-db5d-40a4-a0c0-2b7164ea53c9 req-c27d53dd-006e-4fab-b980-06d980623641 service nova] Acquiring lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1784bad0-db5d-40a4-a0c0-2b7164ea53c9 req-c27d53dd-006e-4fab-b980-06d980623641 service nova] Acquired lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-1784bad0-db5d-40a4-a0c0-2b7164ea53c9 req-c27d53dd-006e-4fab-b980-06d980623641 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing network info cache for port ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-1784bad0-db5d-40a4-a0c0-2b7164ea53c9 req-c27d53dd-006e-4fab-b980-06d980623641 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully updated port: 15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-1784bad0-db5d-40a4-a0c0-2b7164ea53c9 req-c27d53dd-006e-4fab-b980-06d980623641 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1784bad0-db5d-40a4-a0c0-2b7164ea53c9 req-c27d53dd-006e-4fab-b980-06d980623641 service nova] Releasing lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-2d0cf566-4256-4a4c-8468-ff4e51ff76ac req-aa61b4b1-40ee-4cf6-9769-bf4ebd271100 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-changed-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-2d0cf566-4256-4a4c-8468-ff4e51ff76ac req-aa61b4b1-40ee-4cf6-9769-bf4ebd271100 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing instance network info cache due to event network-changed-a0c96475-3d0a-4f2b-9916-19084a41ad14. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2d0cf566-4256-4a4c-8468-ff4e51ff76ac req-aa61b4b1-40ee-4cf6-9769-bf4ebd271100 service nova] Acquiring lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully updated port: 0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-changed-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing instance network info cache due to event network-changed-15c30d3d-d8ea-45e9-9c38-524a09f264ef. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] Acquiring lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] Acquired lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing network info cache for port 15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] Releasing lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-changed-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing instance network info cache due to event network-changed-0f88fc9a-7a42-4ba4-921c-3f7a010fb264. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] Acquiring lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] Acquired lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing network info cache for port 0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d2d20bf3-1229-4c6f-8e00-ce74ac425cdf req-b42574c6-0905-4431-bf42-df1a59aad773 service nova] Releasing lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:26 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully updated port: 2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:26 user nova-compute[70659]: DEBUG nova.network.neutron [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [{"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Releasing lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance network_info: |[{"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:47:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2d0cf566-4256-4a4c-8468-ff4e51ff76ac req-aa61b4b1-40ee-4cf6-9769-bf4ebd271100 service nova] Acquired lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:26 user nova-compute[70659]: DEBUG nova.network.neutron [req-2d0cf566-4256-4a4c-8468-ff4e51ff76ac req-aa61b4b1-40ee-4cf6-9769-bf4ebd271100 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing network info cache for port a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-a7554115-9a48-4553-93c6-48eb094583b8 req-634ba4d1-3f99-4299-886b-5b7bf2e9a846 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-changed-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-a7554115-9a48-4553-93c6-48eb094583b8 req-634ba4d1-3f99-4299-886b-5b7bf2e9a846 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing instance network info cache due to event network-changed-2a328118-fec0-49c6-be72-e9274767e4fb. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a7554115-9a48-4553-93c6-48eb094583b8 req-634ba4d1-3f99-4299-886b-5b7bf2e9a846 service nova] Acquiring lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a7554115-9a48-4553-93c6-48eb094583b8 req-634ba4d1-3f99-4299-886b-5b7bf2e9a846 service nova] Acquired lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:27 user nova-compute[70659]: DEBUG nova.network.neutron [req-a7554115-9a48-4553-93c6-48eb094583b8 req-634ba4d1-3f99-4299-886b-5b7bf2e9a846 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing network info cache for port 2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:27 user nova-compute[70659]: DEBUG nova.network.neutron [req-a7554115-9a48-4553-93c6-48eb094583b8 req-634ba4d1-3f99-4299-886b-5b7bf2e9a846 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:27 user nova-compute[70659]: DEBUG nova.network.neutron [req-a7554115-9a48-4553-93c6-48eb094583b8 req-634ba4d1-3f99-4299-886b-5b7bf2e9a846 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a7554115-9a48-4553-93c6-48eb094583b8 req-634ba4d1-3f99-4299-886b-5b7bf2e9a846 service nova] Releasing lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-2d0cf566-4256-4a4c-8468-ff4e51ff76ac req-aa61b4b1-40ee-4cf6-9769-bf4ebd271100 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updated VIF entry in instance network info cache for port a0c96475-3d0a-4f2b-9916-19084a41ad14. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-2d0cf566-4256-4a4c-8468-ff4e51ff76ac req-aa61b4b1-40ee-4cf6-9769-bf4ebd271100 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [{"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2d0cf566-4256-4a4c-8468-ff4e51ff76ac req-aa61b4b1-40ee-4cf6-9769-bf4ebd271100 service nova] Releasing lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:28 user nova-compute[70659]: INFO nova.virt.block_device [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Booting with volume b923f544-5fb0-4844-8f81-115be6bcb6aa at /dev/vdc
Jul 25 16:47:28 user nova-compute[70659]: DEBUG os_brick.utils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2937e6-3693-4680-b4b6-cfd52e109d20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdadd0b-2193-46c2-af69-e4d491b45d62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5873f5-0415-49ff-b4cc-dc05f2a57b24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c927bf8-9e0f-469a-b0fd-05a000795ee5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:28 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e0f3ab-7dab-4fb5-be6c-3c5646a86171]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG os_brick.utils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating existing volume attachment record: aaa07452-7b35-4a12-a40b-c12e032ac260 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Successfully updated port: a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquired lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:47:28 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:47:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-77dadd7d-6991-4e3e-944b-938fbefa18e2 req-bbcf69da-2d69-4737-af24-83e263657ee4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-changed-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-77dadd7d-6991-4e3e-944b-938fbefa18e2 req-bbcf69da-2d69-4737-af24-83e263657ee4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing instance network info cache due to event network-changed-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-77dadd7d-6991-4e3e-944b-938fbefa18e2 req-bbcf69da-2d69-4737-af24-83e263657ee4 service nova] Acquiring lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:30 user nova-compute[70659]: INFO nova.virt.block_device [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Booting with volume cfddbd88-c48e-47d3-a732-5790aa980709 at /dev/vdc
Jul 25 16:47:30 user nova-compute[70659]: DEBUG os_brick.utils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019093a-89fe-46bc-b842-8e2f638f776a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [{"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1873674-8e5e-4b90-8596-c4d61be5ba22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Releasing lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance network_info: |[{"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90952e3-3140-42bc-bba9-aae3ea5628a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-77dadd7d-6991-4e3e-944b-938fbefa18e2 req-bbcf69da-2d69-4737-af24-83e263657ee4 service nova] Acquired lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG nova.network.neutron [req-77dadd7d-6991-4e3e-944b-938fbefa18e2 req-bbcf69da-2d69-4737-af24-83e263657ee4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing network info cache for port a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5a370a-c709-4739-a6e4-f48c771c910e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:30 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:47:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aadf22b-5a52-4a17-abcc-405cfd1e6591]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG os_brick.utils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:30 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating existing volume attachment record: 8b824e1f-e810-4663-94b3-900a234ae57a {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:47:31 user nova-compute[70659]: DEBUG nova.network.neutron [req-77dadd7d-6991-4e3e-944b-938fbefa18e2 req-bbcf69da-2d69-4737-af24-83e263657ee4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updated VIF entry in instance network info cache for port a12f95a9-424d-4b5b-8c31-54eac1e2c3ed. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:47:31 user nova-compute[70659]: DEBUG nova.network.neutron [req-77dadd7d-6991-4e3e-944b-938fbefa18e2 req-bbcf69da-2d69-4737-af24-83e263657ee4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [{"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-77dadd7d-6991-4e3e-944b-938fbefa18e2 req-bbcf69da-2d69-4737-af24-83e263657ee4 service nova] Releasing lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:47:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Creating image(s)
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Ensure instance console log exists: /opt/stack/data/nova/instances/f576940c-5074-4199-a850-8bf6bf9df4f5/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Start _get_guest_xml network_info=[{"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4bb36167-d858-4788-95ae-99ed827a6d33', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIkfGqxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f576940c-5074-4199-a850-8bf6bf9df4f5', 'attached_at': '', 'detached_at': '', 'volume_id': '9b06b74c-55d9-4002-8dc4-1614fcad7233', 'serial': '9b06b74c-55d9-4002-8dc4-1614fcad7233'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': 'f6a5f3af-a3b9-4a95-980b-697f49abacb7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybwAhesk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f576940c-5074-4199-a850-8bf6bf9df4f5', 'attached_at': '', 'detached_at': '', 'volume_id': '4fd44b09-c1f9-4da3-baf7-1d3b9ca64186', 'serial': '4fd44b09-c1f9-4da3-baf7-1d3b9ca64186'}, 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': 'aaa07452-7b35-4a12-a40b-c12e032ac260', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJQsLytj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f576940c-5074-4199-a850-8bf6bf9df4f5', 'attached_at': '', 'detached_at': '', 'volume_id': 'b923f544-5fb0-4844-8f81-115be6bcb6aa', 'serial': 'b923f544-5fb0-4844-8f81-115be6bcb6aa'}, 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:47:35 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:47:35 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connector [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Factory for ISCSI on None {{(pid=70659) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIkfGqxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:35 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:35 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:35 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c214a291-cb42-41d1-9d2f-f0e89a8946db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:47:35 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a0b2f-a873-41d1-8021-d043e3b9218c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233] added
Jul 25 16:47:35 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af9f026-36bb-40c2-b50f-464342540b48]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[381cbf35-60c8-4862-bd1b-93d0c46042e8]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIkfGqxQ {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIkfGqxQ" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b327be-3e37-4d38-b94e-276b7f361e9e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UIkfGqxQ'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba83b69-6a44-4637-80f3-64d6fc935afd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42aa8f9-a065-4bdb-91b4-1cc61553a788]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:47:35 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:47:35 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:35 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 16:47:35 user nova-compute[70659]: 
Jul 25 16:47:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cd8b98-7068-4004-ab18-49cb711143b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233, portal: 172.16.0.220,3260]
Jul 25 16:47:36 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233, portal: 172.16.0.220,3260] successful.
Jul 25 16:47:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c194167-fe59-481b-83dc-58ee65eb57c7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa8cf68-3536-48e1-9209-3c6e3df66419]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce485f0-33c2-4eb0-b231-dd98b8eabf77]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:47:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIkfGqxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23563633566316262', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563633566316262', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybwAhesk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:37 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:37 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:37 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5271ceb3-e338-4901-adbd-97a9174900c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:47:37 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c1e8ae-a36e-4ad1-b215-93adc25a2409]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186] added
Jul 25 16:47:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5892008d-3e36-4a7f-8634-d4ffb1916803]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3530fb-bb4d-46cb-a167-abe0aad131cf]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybwAhesk {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybwAhesk" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e2aab-8353-4ce7-a54b-082a44ccb7c4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ybwAhesk'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0acfee0-7deb-4d79-83a8-a7ebf9dea155]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7765a2-612c-4290-aa86-320b140d6f67]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[49984d68-d29c-4eab-8dd2-2a78c148fde6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186, portal: 172.16.0.220,3260]
Jul 25 16:47:37 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186, portal: 172.16.0.220,3260] successful.
Jul 25 16:47:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd4d0c8-8ea5-49d4-ba58-80179a251aba]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6d92ed-bd42-4772-8769-6a0bdc67f587]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:37 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:37 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d361bc-997d-4596-9b55-56494f45e01e]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybwAhesk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:47:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:47:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Creating image(s)
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Ensure instance console log exists: /opt/stack/data/nova/instances/0801e7d7-36b9-4e3d-919d-0728ae2e2c29/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Start _get_guest_xml network_info=[{"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2131c7e7-117f-4733-9626-8dd4cec4d3d7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkwKAtNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7f44b4d-b14d-4f3f-a012-1fb73e1f805e', 'serial': 'b7f44b4d-b14d-4f3f-a012-1fb73e1f805e'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '6fb714de-0eab-493b-821e-22fd09ed013a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHVOEBXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29', 'attached_at': '', 'detached_at': '', 'volume_id': '288bdf65-622e-4e9b-a7cc-d375ced26cb7', 'serial': '288bdf65-622e-4e9b-a7cc-d375ced26cb7'}, 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '8b824e1f-e810-4663-94b3-900a234ae57a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwzfpJMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfddbd88-c48e-47d3-a732-5790aa980709', 'serial': 'cfddbd88-c48e-47d3-a732-5790aa980709'}, 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:47:38 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:47:38 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkwKAtNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:38 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26564383830346464', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564383830346464', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.250s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:38 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:38 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04ace7c-af71-41f0-8cc9-fd4d4b0b7580]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:47:38 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJQsLytj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:38 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4d1dd0-2ca5-4816-a383-4927b3645739]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e] added
Jul 25 16:47:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e3c488-e538-4ccb-b97d-57b5faf3ffc2]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe9d663-e48d-4c76-9570-d8bada65e707]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkwKAtNJ {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkwKAtNJ" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7127e6-7553-4ab7-9101-a036a0a99139]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LkwKAtNJ'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32a887f-87c2-45ef-9d2e-4c4aa018326c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99d3ddf-a70c-44cb-93b0-300755bb27ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:38 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:38 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[db133900-4b7a-4d34-9f69-a412cceb8cb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e, portal: 172.16.0.220,3260]
Jul 25 16:47:38 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e, portal: 172.16.0.220,3260] successful.
Jul 25 16:47:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8819dcbb-4fbf-4962-9bba-533367f77ef1]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0994a76b-02c5-4784-b46d-bc894c4c0265]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:38 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:38 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:38 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:38 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[91de313b-1827-4617-867f-105e9907321d]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:47:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkwKAtNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] <== connect_volume: return (1560ms) {'type': 'block', 'scsi_wwn': '23933323665383232', 'path': '/dev/sdd'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933323665383232', 'path': '/dev/sdd'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.280s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:39 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHVOEBXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2761890-8fb5-4528-acee-8b0cc5187acc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:47:39 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[543006d1-93a5-4423-8b51-d36439fc94f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa] added
Jul 25 16:47:39 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4260633-3569-476b-bb35-12e7fc5872e4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0883d9-96ec-4f46-9d94-12b58bc06d88]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJQsLytj {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJQsLytj" returned: 0 in 0.058s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2777f1e9-94c0-4162-b3b5-6805af0708cf]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MJQsLytj'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.097s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f8b6c8-2135-4a1d-aadf-7043af611ebb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d19dfe-a735-4777-993e-083b7da1bc89]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[838443ac-881c-43db-86b9-c37dac09f3f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa, portal: 172.16.0.220,3260]
Jul 25 16:47:40 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa, portal: 172.16.0.220,3260] successful.
Jul 25 16:47:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f324405-052d-4382-a2aa-88796446c1ec]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7b3e73-556d-4be8-8d98-b3748724a62a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:40 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8e3aac-ef2e-416a-84f6-1106c1c6109d]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJQsLytj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] <== connect_volume: return (2715ms) {'type': 'block', 'scsi_wwn': '23538613833326165', 'path': '/dev/sde'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538613833326165', 'path': '/dev/sde'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.411s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:41 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:41 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a2:a4,bridge_name='br-int',has_traffic_filtering=True,id=a91425c6-074b-45e1-8529-fbc20abbeeb1,network=Network(041869d8-93c8-4ce2-b28d-415ec901af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa91425c6-07') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=8307269f-4c27-4543-9d41-e39fc9e555d6,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8307269f-4c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:2f:ef,bridge_name='br-int',has_traffic_filtering=True,id=626d85e1-6b0c-4bb9-aaed-bcfdad48ed57,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap626d85e1-6b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:47,bridge_name='br-int',has_traffic_filtering=True,id=56599ea4-5413-4adb-ab9b-a47b3d5ed020,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56599ea4-54') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:12:5b,bridge_name='br-int',has_traffic_filtering=True,id=7d6092df-2c0e-4f9e-ae16-a8282dc45f03,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d6092df-2c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:24:d5,bridge_name='br-int',has_traffic_filtering=True,id=073a9571-bc46-4f6b-bccd-262a6e05a4c5,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073a9571-bc') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:20:76,bridge_name='br-int',has_traffic_filtering=True,id=a0c96475-3d0a-4f2b-9916-19084a41ad14,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c96475-3d') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.objects.instance [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lazy-loading 'pci_devices' on Instance uuid f576940c-5074-4199-a850-8bf6bf9df4f5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55ce047-e905-4aa1-b17a-a61d7acc47d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:47:41 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:47:41 user nova-compute[70659]:   <uuid>f576940c-5074-4199-a850-8bf6bf9df4f5</uuid>
Jul 25 16:47:41 user nova-compute[70659]:   <name>instance-0000000b</name>
Jul 25 16:47:41 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:47:41 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:47:41 user nova-compute[70659]:   <metadata>
Jul 25 16:47:41 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:47:41 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:47:41 user nova-compute[70659]:       <nova:name>tempest-device-tagging-server-1087783692</nova:name>
Jul 25 16:47:41 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:47:35</nova:creationTime>
Jul 25 16:47:41 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:47:41 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:47:41 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:47:41 user nova-compute[70659]:       <nova:owner>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:user uuid="b5e52d7ac7064f41977498f4d771169c">tempest-TaggedBootDevicesTest-1036210835-project-member</nova:user>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:project uuid="3fb6ec6679fa44c4934e4bb8a6478920">tempest-TaggedBootDevicesTest-1036210835</nova:project>
Jul 25 16:47:41 user nova-compute[70659]:       </nova:owner>
Jul 25 16:47:41 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:47:41 user nova-compute[70659]:       <nova:ports>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:port uuid="a91425c6-074b-45e1-8529-fbc20abbeeb1">
Jul 25 16:47:41 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 16:47:41 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:port uuid="8307269f-4c27-4543-9d41-e39fc9e555d6">
Jul 25 16:47:41 user nova-compute[70659]:           <nova:ip type="fixed" address="10.1.1.152" ipVersion="4"/>
Jul 25 16:47:41 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:port uuid="626d85e1-6b0c-4bb9-aaed-bcfdad48ed57">
Jul 25 16:47:41 user nova-compute[70659]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Jul 25 16:47:41 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:port uuid="56599ea4-5413-4adb-ab9b-a47b3d5ed020">
Jul 25 16:47:41 user nova-compute[70659]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Jul 25 16:47:41 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:port uuid="7d6092df-2c0e-4f9e-ae16-a8282dc45f03">
Jul 25 16:47:41 user nova-compute[70659]:           <nova:ip type="fixed" address="10.1.1.63" ipVersion="4"/>
Jul 25 16:47:41 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:port uuid="073a9571-bc46-4f6b-bccd-262a6e05a4c5">
Jul 25 16:47:41 user nova-compute[70659]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 25 16:47:41 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:41 user nova-compute[70659]:         <nova:port uuid="a0c96475-3d0a-4f2b-9916-19084a41ad14">
Jul 25 16:47:41 user nova-compute[70659]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 25 16:47:41 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:41 user nova-compute[70659]:       </nova:ports>
Jul 25 16:47:41 user nova-compute[70659]:     </nova:instance>
Jul 25 16:47:41 user nova-compute[70659]:   </metadata>
Jul 25 16:47:41 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:47:41 user nova-compute[70659]:     <system>
Jul 25 16:47:41 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:47:41 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:47:41 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:47:41 user nova-compute[70659]:       <entry name="serial">f576940c-5074-4199-a850-8bf6bf9df4f5</entry>
Jul 25 16:47:41 user nova-compute[70659]:       <entry name="uuid">f576940c-5074-4199-a850-8bf6bf9df4f5</entry>
Jul 25 16:47:41 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:47:41 user nova-compute[70659]:     </system>
Jul 25 16:47:41 user nova-compute[70659]:   </sysinfo>
Jul 25 16:47:41 user nova-compute[70659]:   <os>
Jul 25 16:47:41 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:47:41 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:47:41 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:47:41 user nova-compute[70659]:   </os>
Jul 25 16:47:41 user nova-compute[70659]:   <features>
Jul 25 16:47:41 user nova-compute[70659]:     <acpi/>
Jul 25 16:47:41 user nova-compute[70659]:     <apic/>
Jul 25 16:47:41 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:47:41 user nova-compute[70659]:   </features>
Jul 25 16:47:41 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:47:41 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:47:41 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:47:41 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:47:41 user nova-compute[70659]:   </clock>
Jul 25 16:47:41 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:47:41 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:47:41 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:47:41 user nova-compute[70659]:   </cpu>
Jul 25 16:47:41 user nova-compute[70659]:   <devices>
Jul 25 16:47:41 user nova-compute[70659]:     <disk type="file" device="cdrom">
Jul 25 16:47:41 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 16:47:41 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/f576940c-5074-4199-a850-8bf6bf9df4f5/disk.config"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="hda" bus="ide"/>
Jul 25 16:47:41 user nova-compute[70659]:     </disk>
Jul 25 16:47:41 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:47:41 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:47:41 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <serial>9b06b74c-55d9-4002-8dc4-1614fcad7233</serial>
Jul 25 16:47:41 user nova-compute[70659]:     </disk>
Jul 25 16:47:41 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:47:41 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:47:41 user nova-compute[70659]:       <source dev="/dev/sdc"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <serial>4fd44b09-c1f9-4da3-baf7-1d3b9ca64186</serial>
Jul 25 16:47:41 user nova-compute[70659]:     </disk>
Jul 25 16:47:41 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:47:41 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:47:41 user nova-compute[70659]:       <source dev="/dev/sde"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="vdc" bus="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <serial>b923f544-5fb0-4844-8f81-115be6bcb6aa</serial>
Jul 25 16:47:41 user nova-compute[70659]:     </disk>
Jul 25 16:47:41 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:41 user nova-compute[70659]:       <mac address="fa:16:3e:5a:a2:a4"/>
Jul 25 16:47:41 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="tapa91425c6-07"/>
Jul 25 16:47:41 user nova-compute[70659]:     </interface>
Jul 25 16:47:41 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:41 user nova-compute[70659]:       <mac address="fa:16:3e:f0:bb:ee"/>
Jul 25 16:47:41 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="tap8307269f-4c"/>
Jul 25 16:47:41 user nova-compute[70659]:     </interface>
Jul 25 16:47:41 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:41 user nova-compute[70659]:       <mac address="fa:16:3e:72:2f:ef"/>
Jul 25 16:47:41 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="tap626d85e1-6b"/>
Jul 25 16:47:41 user nova-compute[70659]:     </interface>
Jul 25 16:47:41 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:41 user nova-compute[70659]:       <mac address="fa:16:3e:63:38:47"/>
Jul 25 16:47:41 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="tap56599ea4-54"/>
Jul 25 16:47:41 user nova-compute[70659]:     </interface>
Jul 25 16:47:41 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:41 user nova-compute[70659]:       <mac address="fa:16:3e:58:12:5b"/>
Jul 25 16:47:41 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="tap7d6092df-2c"/>
Jul 25 16:47:41 user nova-compute[70659]:     </interface>
Jul 25 16:47:41 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:41 user nova-compute[70659]:       <mac address="fa:16:3e:06:24:d5"/>
Jul 25 16:47:41 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="tap073a9571-bc"/>
Jul 25 16:47:41 user nova-compute[70659]:     </interface>
Jul 25 16:47:41 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:41 user nova-compute[70659]:       <mac address="fa:16:3e:3a:20:76"/>
Jul 25 16:47:41 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:41 user nova-compute[70659]:       <target dev="tapa0c96475-3d"/>
Jul 25 16:47:41 user nova-compute[70659]:     </interface>
Jul 25 16:47:41 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:47:41 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/f576940c-5074-4199-a850-8bf6bf9df4f5/console.log" append="off"/>
Jul 25 16:47:41 user nova-compute[70659]:     </serial>
Jul 25 16:47:41 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:47:41 user nova-compute[70659]:     <video>
Jul 25 16:47:41 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:41 user nova-compute[70659]:     </video>
Jul 25 16:47:41 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:47:41 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:47:41 user nova-compute[70659]:     </rng>
Jul 25 16:47:41 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:47:41 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:47:41 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:47:41 user nova-compute[70659]:     </memballoon>
Jul 25 16:47:41 user nova-compute[70659]:   </devices>
Jul 25 16:47:41 user nova-compute[70659]: </domain>
Jul 25 16:47:41 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a2:a4,bridge_name='br-int',has_traffic_filtering=True,id=a91425c6-074b-45e1-8529-fbc20abbeeb1,network=Network(041869d8-93c8-4ce2-b28d-415ec901af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa91425c6-07') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a2:a4,bridge_name='br-int',has_traffic_filtering=True,id=a91425c6-074b-45e1-8529-fbc20abbeeb1,network=Network(041869d8-93c8-4ce2-b28d-415ec901af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa91425c6-07') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa91425c6-07, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa91425c6-07, col_values=(('external_ids', {'iface-id': 'a91425c6-074b-45e1-8529-fbc20abbeeb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:a2:a4', 'vm-uuid': 'f576940c-5074-4199-a850-8bf6bf9df4f5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f634b9-a44f-4ece-92c0-364fa8abf450]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7] added
Jul 25 16:47:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: INFO os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:a2:a4,bridge_name='br-int',has_traffic_filtering=True,id=a91425c6-074b-45e1-8529-fbc20abbeeb1,network=Network(041869d8-93c8-4ce2-b28d-415ec901af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa91425c6-07')
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=8307269f-4c27-4543-9d41-e39fc9e555d6,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8307269f-4c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=8307269f-4c27-4543-9d41-e39fc9e555d6,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8307269f-4c') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8307269f-4c, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8307269f-4c, col_values=(('external_ids', {'iface-id': '8307269f-4c27-4543-9d41-e39fc9e555d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:bb:ee', 'vm-uuid': 'f576940c-5074-4199-a850-8bf6bf9df4f5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4877f5d-8495-4950-bc02-9c11a861f677]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: INFO os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=8307269f-4c27-4543-9d41-e39fc9e555d6,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8307269f-4c')
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:2f:ef,bridge_name='br-int',has_traffic_filtering=True,id=626d85e1-6b0c-4bb9-aaed-bcfdad48ed57,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap626d85e1-6b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:2f:ef,bridge_name='br-int',has_traffic_filtering=True,id=626d85e1-6b0c-4bb9-aaed-bcfdad48ed57,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap626d85e1-6b') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3052197d-db8d-4461-8c2b-d350f75fb23e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap626d85e1-6b, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap626d85e1-6b, col_values=(('external_ids', {'iface-id': '626d85e1-6b0c-4bb9-aaed-bcfdad48ed57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:2f:ef', 'vm-uuid': 'f576940c-5074-4199-a850-8bf6bf9df4f5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHVOEBXm {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHVOEBXm" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6305742-a8d7-4f82-96c7-ef7452ac1e08]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vHVOEBXm'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: INFO os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:2f:ef,bridge_name='br-int',has_traffic_filtering=True,id=626d85e1-6b0c-4bb9-aaed-bcfdad48ed57,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap626d85e1-6b')
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:47,bridge_name='br-int',has_traffic_filtering=True,id=56599ea4-5413-4adb-ab9b-a47b3d5ed020,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56599ea4-54') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:47,bridge_name='br-int',has_traffic_filtering=True,id=56599ea4-5413-4adb-ab9b-a47b3d5ed020,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56599ea4-54') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7321f200-1aaf-4b94-8f6d-e816e6329a5c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56599ea4-54, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56599ea4-54, col_values=(('external_ids', {'iface-id': '56599ea4-5413-4adb-ab9b-a47b3d5ed020', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:38:47', 'vm-uuid': 'f576940c-5074-4199-a850-8bf6bf9df4f5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c21eb-f969-4246-95de-9af99ef841c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: INFO os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:47,bridge_name='br-int',has_traffic_filtering=True,id=56599ea4-5413-4adb-ab9b-a47b3d5ed020,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56599ea4-54')
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:12:5b,bridge_name='br-int',has_traffic_filtering=True,id=7d6092df-2c0e-4f9e-ae16-a8282dc45f03,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d6092df-2c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:12:5b,bridge_name='br-int',has_traffic_filtering=True,id=7d6092df-2c0e-4f9e-ae16-a8282dc45f03,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d6092df-2c') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d6092df-2c, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d6092df-2c, col_values=(('external_ids', {'iface-id': '7d6092df-2c0e-4f9e-ae16-a8282dc45f03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:12:5b', 'vm-uuid': 'f576940c-5074-4199-a850-8bf6bf9df4f5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f7fb8-a465-41c4-9b9a-8599bd2b3ad9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7, portal: 172.16.0.220,3260]
Jul 25 16:47:41 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7, portal: 172.16.0.220,3260] successful.
Jul 25 16:47:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: INFO os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:12:5b,bridge_name='br-int',has_traffic_filtering=True,id=7d6092df-2c0e-4f9e-ae16-a8282dc45f03,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d6092df-2c')
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:24:d5,bridge_name='br-int',has_traffic_filtering=True,id=073a9571-bc46-4f6b-bccd-262a6e05a4c5,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073a9571-bc') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:24:d5,bridge_name='br-int',has_traffic_filtering=True,id=073a9571-bc46-4f6b-bccd-262a6e05a4c5,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073a9571-bc') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[679705a4-e69f-4549-906c-5256f38e46aa]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap073a9571-bc, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap073a9571-bc, col_values=(('external_ids', {'iface-id': '073a9571-bc46-4f6b-bccd-262a6e05a4c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:24:d5', 'vm-uuid': 'f576940c-5074-4199-a850-8bf6bf9df4f5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27792c6-208b-44d3-8dbd-1368cbfe45b3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:41 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: INFO os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:24:d5,bridge_name='br-int',has_traffic_filtering=True,id=073a9571-bc46-4f6b-bccd-262a6e05a4c5,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073a9571-bc')
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:20:76,bridge_name='br-int',has_traffic_filtering=True,id=a0c96475-3d0a-4f2b-9916-19084a41ad14,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c96475-3d') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:20:76,bridge_name='br-int',has_traffic_filtering=True,id=a0c96475-3d0a-4f2b-9916-19084a41ad14,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c96475-3d') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d9cd3b-4716-4c19-845a-2e8eb4bfc070]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHVOEBXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0c96475-3d, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0c96475-3d, col_values=(('external_ids', {'iface-id': 'a0c96475-3d0a-4f2b-9916-19084a41ad14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:20:76', 'vm-uuid': 'f576940c-5074-4199-a850-8bf6bf9df4f5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:41 user nova-compute[70659]: INFO os_vif [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:20:76,bridge_name='br-int',has_traffic_filtering=True,id=a0c96475-3d0a-4f2b-9916-19084a41ad14,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c96475-3d')
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] No BDM found with device name hda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] No VIF found with MAC fa:16:3e:5a:a2:a4, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] No VIF found with MAC fa:16:3e:58:12:5b, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:47:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Using config drive
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Creating config drive at /opt/stack/data/nova/instances/f576940c-5074-4199-a850-8bf6bf9df4f5/disk.config
Jul 25 16:47:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f576940c-5074-4199-a850-8bf6bf9df4f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprb_t4v0p {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f576940c-5074-4199-a850-8bf6bf9df4f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprb_t4v0p" returned: 0 in 0.068s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.463s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] <== connect_volume: return (2876ms) {'type': 'block', 'scsi_wwn': '26232326663363763', 'path': '/dev/sdf'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232326663363763', 'path': '/dev/sdf'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwzfpJMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:42 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:42 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:42 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7957dad5-0f86-42a4-97ec-1c166b81117c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:47:42 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2371767b-8939-4c75-b17a-15372a2cdfcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709] added
Jul 25 16:47:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec4608e-27f2-401c-917a-ef54e1414a3b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb73c1b0-9118-41fe-9664-5774121dce8e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwzfpJMB {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwzfpJMB" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d64b2e4-d312-4575-ba72-71463f891924]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UwzfpJMB'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39eb3bd-525c-406c-b4d2-4703ff2cee0b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1939d7-d002-4cce-a005-77886b11cb17]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:42 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:42 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:42 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:42 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:42 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:42 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:42 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:42 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beadc10-f0ec-4293-90b9-12199e74ee50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709, portal: 172.16.0.220,3260]
Jul 25 16:47:43 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709, portal: 172.16.0.220,3260] successful.
Jul 25 16:47:43 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a8a167-a868-4eb6-bcf8-70cc875c480b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a658b81d-2070-4eee-b346-4979b96583aa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:47:43 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:43 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:47:43 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[36de227e-3b82-4326-a4f2-d2e1caba8292]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwzfpJMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-68bd0c2e-3ad8-418b-a7a0-158790d40f09 req-06da9327-b96b-48f8-a860-872d384de870 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-68bd0c2e-3ad8-418b-a7a0-158790d40f09 req-06da9327-b96b-48f8-a860-872d384de870 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-68bd0c2e-3ad8-418b-a7a0-158790d40f09 req-06da9327-b96b-48f8-a860-872d384de870 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-68bd0c2e-3ad8-418b-a7a0-158790d40f09 req-06da9327-b96b-48f8-a860-872d384de870 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-68bd0c2e-3ad8-418b-a7a0-158790d40f09 req-06da9327-b96b-48f8-a860-872d384de870 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:44 user nova-compute[70659]: WARNING nova.compute.manager [req-68bd0c2e-3ad8-418b-a7a0-158790d40f09 req-06da9327-b96b-48f8-a860-872d384de870 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 for instance with vm_state building and task_state spawning.
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '26533616363343261', 'path': '/dev/sdg'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533616363343261', 'path': '/dev/sdg'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:87:67,bridge_name='br-int',has_traffic_filtering=True,id=a81b2274-5695-4d3e-9543-b8b1f24ab8d9,network=Network(42ed7322-c794-467c-999f-c4c43ed2e7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b2274-56') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:e1:d2,bridge_name='br-int',has_traffic_filtering=True,id=3a834d3c-ee6d-4582-bee2-3da76e26cbca,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a834d3c-ee') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:77:3a,bridge_name='br-int',has_traffic_filtering=True,id=ccd6efc2-4bf4-4af9-9f85-bb175b743b0b,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapccd6efc2-4b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:8b,bridge_name='br-int',has_traffic_filtering=True,id=15c30d3d-d8ea-45e9-9c38-524a09f264ef,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c30d3d-d8') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fd:f5,bridge_name='br-int',has_traffic_filtering=True,id=0f88fc9a-7a42-4ba4-921c-3f7a010fb264,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88fc9a-7a') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6b:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a328118-fec0-49c6-be72-e9274767e4fb,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a328118-fe') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=a12f95a9-424d-4b5b-8c31-54eac1e2c3ed,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa12f95a9-42') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lazy-loading 'pci_devices' on Instance uuid 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:47:44 user nova-compute[70659]:   <uuid>0801e7d7-36b9-4e3d-919d-0728ae2e2c29</uuid>
Jul 25 16:47:44 user nova-compute[70659]:   <name>instance-0000000c</name>
Jul 25 16:47:44 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:47:44 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:47:44 user nova-compute[70659]:   <metadata>
Jul 25 16:47:44 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:47:44 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:47:44 user nova-compute[70659]:       <nova:name>tempest-device-tagging-server-1172446140</nova:name>
Jul 25 16:47:44 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:47:38</nova:creationTime>
Jul 25 16:47:44 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:47:44 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:47:44 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:47:44 user nova-compute[70659]:       <nova:owner>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:user uuid="83ffbc9e4ab54d1a98a0bdfddb7b9868">tempest-TaggedBootDevicesTest_v242-858302614-project-member</nova:user>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:project uuid="1b0e568f9df34d918c1684e2e93ad659">tempest-TaggedBootDevicesTest_v242-858302614</nova:project>
Jul 25 16:47:44 user nova-compute[70659]:       </nova:owner>
Jul 25 16:47:44 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:47:44 user nova-compute[70659]:       <nova:ports>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:port uuid="a81b2274-5695-4d3e-9543-b8b1f24ab8d9">
Jul 25 16:47:44 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 16:47:44 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:port uuid="3a834d3c-ee6d-4582-bee2-3da76e26cbca">
Jul 25 16:47:44 user nova-compute[70659]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Jul 25 16:47:44 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:port uuid="ccd6efc2-4bf4-4af9-9f85-bb175b743b0b">
Jul 25 16:47:44 user nova-compute[70659]:           <nova:ip type="fixed" address="10.1.1.161" ipVersion="4"/>
Jul 25 16:47:44 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:port uuid="15c30d3d-d8ea-45e9-9c38-524a09f264ef">
Jul 25 16:47:44 user nova-compute[70659]:           <nova:ip type="fixed" address="10.1.1.74" ipVersion="4"/>
Jul 25 16:47:44 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:port uuid="0f88fc9a-7a42-4ba4-921c-3f7a010fb264">
Jul 25 16:47:44 user nova-compute[70659]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
Jul 25 16:47:44 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:port uuid="2a328118-fec0-49c6-be72-e9274767e4fb">
Jul 25 16:47:44 user nova-compute[70659]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 25 16:47:44 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:44 user nova-compute[70659]:         <nova:port uuid="a12f95a9-424d-4b5b-8c31-54eac1e2c3ed">
Jul 25 16:47:44 user nova-compute[70659]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 25 16:47:44 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:44 user nova-compute[70659]:       </nova:ports>
Jul 25 16:47:44 user nova-compute[70659]:     </nova:instance>
Jul 25 16:47:44 user nova-compute[70659]:   </metadata>
Jul 25 16:47:44 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:47:44 user nova-compute[70659]:     <system>
Jul 25 16:47:44 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:47:44 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:47:44 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:47:44 user nova-compute[70659]:       <entry name="serial">0801e7d7-36b9-4e3d-919d-0728ae2e2c29</entry>
Jul 25 16:47:44 user nova-compute[70659]:       <entry name="uuid">0801e7d7-36b9-4e3d-919d-0728ae2e2c29</entry>
Jul 25 16:47:44 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:47:44 user nova-compute[70659]:     </system>
Jul 25 16:47:44 user nova-compute[70659]:   </sysinfo>
Jul 25 16:47:44 user nova-compute[70659]:   <os>
Jul 25 16:47:44 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:47:44 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:47:44 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:47:44 user nova-compute[70659]:   </os>
Jul 25 16:47:44 user nova-compute[70659]:   <features>
Jul 25 16:47:44 user nova-compute[70659]:     <acpi/>
Jul 25 16:47:44 user nova-compute[70659]:     <apic/>
Jul 25 16:47:44 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:47:44 user nova-compute[70659]:   </features>
Jul 25 16:47:44 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:47:44 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:47:44 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:47:44 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:47:44 user nova-compute[70659]:   </clock>
Jul 25 16:47:44 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:47:44 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:47:44 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:47:44 user nova-compute[70659]:   </cpu>
Jul 25 16:47:44 user nova-compute[70659]:   <devices>
Jul 25 16:47:44 user nova-compute[70659]:     <disk type="file" device="cdrom">
Jul 25 16:47:44 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 16:47:44 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/0801e7d7-36b9-4e3d-919d-0728ae2e2c29/disk.config"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="hda" bus="ide"/>
Jul 25 16:47:44 user nova-compute[70659]:     </disk>
Jul 25 16:47:44 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:47:44 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:47:44 user nova-compute[70659]:       <source dev="/dev/sdd"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <serial>b7f44b4d-b14d-4f3f-a012-1fb73e1f805e</serial>
Jul 25 16:47:44 user nova-compute[70659]:     </disk>
Jul 25 16:47:44 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:47:44 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:47:44 user nova-compute[70659]:       <source dev="/dev/sdf"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <serial>288bdf65-622e-4e9b-a7cc-d375ced26cb7</serial>
Jul 25 16:47:44 user nova-compute[70659]:     </disk>
Jul 25 16:47:44 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:47:44 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:47:44 user nova-compute[70659]:       <source dev="/dev/sdg"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="vdc" bus="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <serial>cfddbd88-c48e-47d3-a732-5790aa980709</serial>
Jul 25 16:47:44 user nova-compute[70659]:     </disk>
Jul 25 16:47:44 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:44 user nova-compute[70659]:       <mac address="fa:16:3e:b9:87:67"/>
Jul 25 16:47:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="tapa81b2274-56"/>
Jul 25 16:47:44 user nova-compute[70659]:     </interface>
Jul 25 16:47:44 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:44 user nova-compute[70659]:       <mac address="fa:16:3e:29:e1:d2"/>
Jul 25 16:47:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="tap3a834d3c-ee"/>
Jul 25 16:47:44 user nova-compute[70659]:     </interface>
Jul 25 16:47:44 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:44 user nova-compute[70659]:       <mac address="fa:16:3e:8a:77:3a"/>
Jul 25 16:47:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="tapccd6efc2-4b"/>
Jul 25 16:47:44 user nova-compute[70659]:     </interface>
Jul 25 16:47:44 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:44 user nova-compute[70659]:       <mac address="fa:16:3e:26:a7:8b"/>
Jul 25 16:47:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="tap15c30d3d-d8"/>
Jul 25 16:47:44 user nova-compute[70659]:     </interface>
Jul 25 16:47:44 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:44 user nova-compute[70659]:       <mac address="fa:16:3e:7f:fd:f5"/>
Jul 25 16:47:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="tap0f88fc9a-7a"/>
Jul 25 16:47:44 user nova-compute[70659]:     </interface>
Jul 25 16:47:44 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:44 user nova-compute[70659]:       <mac address="fa:16:3e:47:6b:1a"/>
Jul 25 16:47:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="tap2a328118-fe"/>
Jul 25 16:47:44 user nova-compute[70659]:     </interface>
Jul 25 16:47:44 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:44 user nova-compute[70659]:       <mac address="fa:16:3e:8d:4a:db"/>
Jul 25 16:47:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:44 user nova-compute[70659]:       <target dev="tapa12f95a9-42"/>
Jul 25 16:47:44 user nova-compute[70659]:     </interface>
Jul 25 16:47:44 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:47:44 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/0801e7d7-36b9-4e3d-919d-0728ae2e2c29/console.log" append="off"/>
Jul 25 16:47:44 user nova-compute[70659]:     </serial>
Jul 25 16:47:44 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:47:44 user nova-compute[70659]:     <video>
Jul 25 16:47:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:44 user nova-compute[70659]:     </video>
Jul 25 16:47:44 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:47:44 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:47:44 user nova-compute[70659]:     </rng>
Jul 25 16:47:44 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:47:44 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:47:44 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:47:44 user nova-compute[70659]:     </memballoon>
Jul 25 16:47:44 user nova-compute[70659]:   </devices>
Jul 25 16:47:44 user nova-compute[70659]: </domain>
Jul 25 16:47:44 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:87:67,bridge_name='br-int',has_traffic_filtering=True,id=a81b2274-5695-4d3e-9543-b8b1f24ab8d9,network=Network(42ed7322-c794-467c-999f-c4c43ed2e7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b2274-56') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:87:67,bridge_name='br-int',has_traffic_filtering=True,id=a81b2274-5695-4d3e-9543-b8b1f24ab8d9,network=Network(42ed7322-c794-467c-999f-c4c43ed2e7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b2274-56') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa81b2274-56, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa81b2274-56, col_values=(('external_ids', {'iface-id': 'a81b2274-5695-4d3e-9543-b8b1f24ab8d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:87:67', 'vm-uuid': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: INFO os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:87:67,bridge_name='br-int',has_traffic_filtering=True,id=a81b2274-5695-4d3e-9543-b8b1f24ab8d9,network=Network(42ed7322-c794-467c-999f-c4c43ed2e7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b2274-56')
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:e1:d2,bridge_name='br-int',has_traffic_filtering=True,id=3a834d3c-ee6d-4582-bee2-3da76e26cbca,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a834d3c-ee') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:e1:d2,bridge_name='br-int',has_traffic_filtering=True,id=3a834d3c-ee6d-4582-bee2-3da76e26cbca,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a834d3c-ee') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a834d3c-ee, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a834d3c-ee, col_values=(('external_ids', {'iface-id': '3a834d3c-ee6d-4582-bee2-3da76e26cbca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:e1:d2', 'vm-uuid': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: INFO os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:e1:d2,bridge_name='br-int',has_traffic_filtering=True,id=3a834d3c-ee6d-4582-bee2-3da76e26cbca,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a834d3c-ee')
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:77:3a,bridge_name='br-int',has_traffic_filtering=True,id=ccd6efc2-4bf4-4af9-9f85-bb175b743b0b,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapccd6efc2-4b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:77:3a,bridge_name='br-int',has_traffic_filtering=True,id=ccd6efc2-4bf4-4af9-9f85-bb175b743b0b,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapccd6efc2-4b') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccd6efc2-4b, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapccd6efc2-4b, col_values=(('external_ids', {'iface-id': 'ccd6efc2-4bf4-4af9-9f85-bb175b743b0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:77:3a', 'vm-uuid': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: INFO os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:77:3a,bridge_name='br-int',has_traffic_filtering=True,id=ccd6efc2-4bf4-4af9-9f85-bb175b743b0b,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapccd6efc2-4b')
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:8b,bridge_name='br-int',has_traffic_filtering=True,id=15c30d3d-d8ea-45e9-9c38-524a09f264ef,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c30d3d-d8') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:8b,bridge_name='br-int',has_traffic_filtering=True,id=15c30d3d-d8ea-45e9-9c38-524a09f264ef,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c30d3d-d8') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15c30d3d-d8, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15c30d3d-d8, col_values=(('external_ids', {'iface-id': '15c30d3d-d8ea-45e9-9c38-524a09f264ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:a7:8b', 'vm-uuid': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: INFO os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:8b,bridge_name='br-int',has_traffic_filtering=True,id=15c30d3d-d8ea-45e9-9c38-524a09f264ef,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c30d3d-d8')
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fd:f5,bridge_name='br-int',has_traffic_filtering=True,id=0f88fc9a-7a42-4ba4-921c-3f7a010fb264,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88fc9a-7a') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fd:f5,bridge_name='br-int',has_traffic_filtering=True,id=0f88fc9a-7a42-4ba4-921c-3f7a010fb264,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88fc9a-7a') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f88fc9a-7a, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f88fc9a-7a, col_values=(('external_ids', {'iface-id': '0f88fc9a-7a42-4ba4-921c-3f7a010fb264', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:fd:f5', 'vm-uuid': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303668.3027563, f576940c-5074-4199-a850-8bf6bf9df4f5 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] VM Resumed (Lifecycle Event)
Jul 25 16:47:48 user nova-compute[70659]: INFO os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fd:f5,bridge_name='br-int',has_traffic_filtering=True,id=0f88fc9a-7a42-4ba4-921c-3f7a010fb264,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88fc9a-7a')
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6b:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a328118-fec0-49c6-be72-e9274767e4fb,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a328118-fe') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6b:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a328118-fec0-49c6-be72-e9274767e4fb,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a328118-fe') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e46c3dd3-ed93-48f3-807a-da0adfa363f5 req-7e183fe3-f9e4-4a06-880e-28be816a1855 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e46c3dd3-ed93-48f3-807a-da0adfa363f5 req-7e183fe3-f9e4-4a06-880e-28be816a1855 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e46c3dd3-ed93-48f3-807a-da0adfa363f5 req-7e183fe3-f9e4-4a06-880e-28be816a1855 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e46c3dd3-ed93-48f3-807a-da0adfa363f5 req-7e183fe3-f9e4-4a06-880e-28be816a1855 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e46c3dd3-ed93-48f3-807a-da0adfa363f5 req-7e183fe3-f9e4-4a06-880e-28be816a1855 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-e46c3dd3-ed93-48f3-807a-da0adfa363f5 req-7e183fe3-f9e4-4a06-880e-28be816a1855 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-8307269f-4c27-4543-9d41-e39fc9e555d6 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-8307269f-4c27-4543-9d41-e39fc9e555d6 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-e6c4fd30-a81c-4c92-83a0-4f49f0957c53 req-7031ac7f-e513-426b-af28-16d557ddf88b service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-bd05aee1-b05c-4a77-a339-b732addb9b85 req-ccf53d33-3526-4807-9c65-ee94819756f9 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.compute.manager [req-6f03d5fc-5229-476d-b066-a2d3ba0c2711 req-12180f35-407b-407b-b40c-d4b97fdab461 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 for instance with vm_state building and task_state spawning.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.compute.manager [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Rescuing
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquired lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a328118-fe, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a328118-fe, col_values=(('external_ids', {'iface-id': '2a328118-fec0-49c6-be72-e9274767e4fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:6b:1a', 'vm-uuid': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.objects.instance [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lazy-loading 'flavor' on Instance uuid 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance spawned successfully.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:47:48 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=6753MB free_disk=25.59435272216797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:48 user nova-compute[70659]: INFO os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6b:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a328118-fec0-49c6-be72-e9274767e4fb,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a328118-fe')
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=a12f95a9-424d-4b5b-8c31-54eac1e2c3ed,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa12f95a9-42') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=a12f95a9-424d-4b5b-8c31-54eac1e2c3ed,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa12f95a9-42') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303668.3048992, f576940c-5074-4199-a850-8bf6bf9df4f5 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] VM Started (Lifecycle Event)
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa12f95a9-42, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa12f95a9-42, col_values=(('external_ids', {'iface-id': 'a12f95a9-424d-4b5b-8c31-54eac1e2c3ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:4a:db', 'vm-uuid': '0801e7d7-36b9-4e3d-919d-0728ae2e2c29'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:48 user nova-compute[70659]: INFO os_vif [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=a12f95a9-424d-4b5b-8c31-54eac1e2c3ed,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa12f95a9-42')
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Took 13.05 seconds to spawn the instance on the hypervisor.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] No BDM found with device name hda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] No VIF found with MAC fa:16:3e:b9:87:67, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] No VIF found with MAC fa:16:3e:7f:fd:f5, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Using config drive
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c9728d00-f454-4616-af0b-8cfd0f012cad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 7d47d257-3a12-48d8-bdb1-adec83869c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 98c0757f-7146-48ea-ac36-e7c107e74d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f576940c-5074-4199-a850-8bf6bf9df4f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.compute.manager [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Took 39.18 seconds to build instance.
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-62bec7f0-c544-4072-8ee9-cb450bebe55d tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.279s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:48 user nova-compute[70659]: INFO nova.compute.manager [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Attaching volume 7856ad25-95e5-49dd-96ba-b2500bdef0c6 to /dev/vdb
Jul 25 16:47:48 user nova-compute[70659]: DEBUG os_brick.utils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eca3301-3728-48d7-906d-b337de2b052f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.041s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0590df55-5bb0-4532-932c-aab718cf4a85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d981acf5-5aee-482c-bdbb-b4154beb6113]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fff9dd-41e8-4350-b796-3f8d9c85e4c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:49 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4bfe0d-b093-4524-8956-8ee4d64d399b]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG os_brick.utils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Updating existing volume attachment record: 75036543-2a98-4a9c-bef0-78469d5251cb {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-e5e4f8bb-41c3-4816-8f62-f6160756d1db req-83f348a2-a196-47a1-a500-b397d7f0a1e2 service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received event network-changed-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-e5e4f8bb-41c3-4816-8f62-f6160756d1db req-83f348a2-a196-47a1-a500-b397d7f0a1e2 service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Refreshing instance network info cache due to event network-changed-59982e84-3ac0-4ed7-b932-9fd142d77f8a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e5e4f8bb-41c3-4816-8f62-f6160756d1db req-83f348a2-a196-47a1-a500-b397d7f0a1e2 service nova] Acquiring lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e5e4f8bb-41c3-4816-8f62-f6160756d1db req-83f348a2-a196-47a1-a500-b397d7f0a1e2 service nova] Acquired lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG nova.network.neutron [req-e5e4f8bb-41c3-4816-8f62-f6160756d1db req-83f348a2-a196-47a1-a500-b397d7f0a1e2 service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Refreshing network info cache for port 59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.722s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:49 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Creating config drive at /opt/stack/data/nova/instances/0801e7d7-36b9-4e3d-919d-0728ae2e2c29/disk.config
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0801e7d7-36b9-4e3d-919d-0728ae2e2c29/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiu4m10es {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0801e7d7-36b9-4e3d-919d-0728ae2e2c29/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiu4m10es" returned: 0 in 0.065s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Updating instance_info_cache with network_info: [{"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Releasing lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-7c9ddadf-3e5f-462d-a39d-48078a65b2b7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-7c9ddadf-3e5f-462d-a39d-48078a65b2b7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-1cc75ad8-d71a-45b1-a552-9424c4aa0596 req-2fd8b84e-d15d-4aae-8a5f-c3cf16a1c5b2 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-unplugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1cc75ad8-d71a-45b1-a552-9424c4aa0596 req-2fd8b84e-d15d-4aae-8a5f-c3cf16a1c5b2 service nova] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1cc75ad8-d71a-45b1-a552-9424c4aa0596 req-2fd8b84e-d15d-4aae-8a5f-c3cf16a1c5b2 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1cc75ad8-d71a-45b1-a552-9424c4aa0596 req-2fd8b84e-d15d-4aae-8a5f-c3cf16a1c5b2 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-1cc75ad8-d71a-45b1-a552-9424c4aa0596 req-2fd8b84e-d15d-4aae-8a5f-c3cf16a1c5b2 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] No waiting events found dispatching network-vif-unplugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:50 user nova-compute[70659]: WARNING nova.compute.manager [req-1cc75ad8-d71a-45b1-a552-9424c4aa0596 req-2fd8b84e-d15d-4aae-8a5f-c3cf16a1c5b2 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received unexpected event network-vif-unplugged-f5aac860-4fc0-4097-8275-2243915c868b for instance with vm_state active and task_state rescuing.
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.network.neutron [req-e5e4f8bb-41c3-4816-8f62-f6160756d1db req-83f348a2-a196-47a1-a500-b397d7f0a1e2 service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Updated VIF entry in instance network info cache for port 59982e84-3ac0-4ed7-b932-9fd142d77f8a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.network.neutron [req-e5e4f8bb-41c3-4816-8f62-f6160756d1db req-83f348a2-a196-47a1-a500-b397d7f0a1e2 service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Updating instance_info_cache with network_info: [{"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e5e4f8bb-41c3-4816-8f62-f6160756d1db req-83f348a2-a196-47a1-a500-b397d7f0a1e2 service nova] Releasing lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Updating instance_info_cache with network_info: [{"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-7c9ddadf-3e5f-462d-a39d-48078a65b2b7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:47:51 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Instance destroyed successfully.
Jul 25 16:47:51 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Attempting rescue
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70659) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Instance directory exists: not creating {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 16:47:51 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Creating image(s)
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'trusted_certs' on Instance uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.188s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue" returned: 0 in 0.072s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'migration_context' on Instance uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Start _get_guest_xml network_info=[{"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "vif_mac": "fa:16:3e:c2:a0:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'resources' on Instance uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'numa_topology' on Instance uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:51 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:47:51 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:47:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:47:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'vcpu_model' on Instance uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641327865',display_name='tempest-ServerRescueNegativeTestJSON-server-1641327865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641327865',id=3,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-dd57sdib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:14Z,user_data=None,user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "vif_mac": "fa:16:3e:c2:a0:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "vif_mac": "fa:16:3e:c2:a0:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a0:42,bridge_name='br-int',has_traffic_filtering=True,id=f5aac860-4fc0-4097-8275-2243915c868b,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5aac860-4f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'pci_devices' on Instance uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:47:52 user nova-compute[70659]:   <uuid>fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7</uuid>
Jul 25 16:47:52 user nova-compute[70659]:   <name>instance-00000003</name>
Jul 25 16:47:52 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:47:52 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:47:52 user nova-compute[70659]:   <metadata>
Jul 25 16:47:52 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:47:52 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:47:52 user nova-compute[70659]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1641327865</nova:name>
Jul 25 16:47:52 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:47:51</nova:creationTime>
Jul 25 16:47:52 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:47:52 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:47:52 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:47:52 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:47:52 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:47:52 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:47:52 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:47:52 user nova-compute[70659]:       <nova:owner>
Jul 25 16:47:52 user nova-compute[70659]:         <nova:user uuid="9aaa70e5cce7418b96837e30769ac6aa">tempest-ServerRescueNegativeTestJSON-1539045365-project-member</nova:user>
Jul 25 16:47:52 user nova-compute[70659]:         <nova:project uuid="d20acc57667b418ba16f573fe81841ac">tempest-ServerRescueNegativeTestJSON-1539045365</nova:project>
Jul 25 16:47:52 user nova-compute[70659]:       </nova:owner>
Jul 25 16:47:52 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:47:52 user nova-compute[70659]:       <nova:ports>
Jul 25 16:47:52 user nova-compute[70659]:         <nova:port uuid="f5aac860-4fc0-4097-8275-2243915c868b">
Jul 25 16:47:52 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 16:47:52 user nova-compute[70659]:         </nova:port>
Jul 25 16:47:52 user nova-compute[70659]:       </nova:ports>
Jul 25 16:47:52 user nova-compute[70659]:     </nova:instance>
Jul 25 16:47:52 user nova-compute[70659]:   </metadata>
Jul 25 16:47:52 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:47:52 user nova-compute[70659]:     <system>
Jul 25 16:47:52 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:47:52 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:47:52 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:47:52 user nova-compute[70659]:       <entry name="serial">fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7</entry>
Jul 25 16:47:52 user nova-compute[70659]:       <entry name="uuid">fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7</entry>
Jul 25 16:47:52 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:47:52 user nova-compute[70659]:     </system>
Jul 25 16:47:52 user nova-compute[70659]:   </sysinfo>
Jul 25 16:47:52 user nova-compute[70659]:   <os>
Jul 25 16:47:52 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:47:52 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:47:52 user nova-compute[70659]:   </os>
Jul 25 16:47:52 user nova-compute[70659]:   <features>
Jul 25 16:47:52 user nova-compute[70659]:     <acpi/>
Jul 25 16:47:52 user nova-compute[70659]:     <apic/>
Jul 25 16:47:52 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:47:52 user nova-compute[70659]:   </features>
Jul 25 16:47:52 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:47:52 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:47:52 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:47:52 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:47:52 user nova-compute[70659]:   </clock>
Jul 25 16:47:52 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:47:52 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:47:52 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:47:52 user nova-compute[70659]:   </cpu>
Jul 25 16:47:52 user nova-compute[70659]:   <devices>
Jul 25 16:47:52 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:47:52 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:47:52 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue"/>
Jul 25 16:47:52 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:47:52 user nova-compute[70659]:     </disk>
Jul 25 16:47:52 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:47:52 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:47:52 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk"/>
Jul 25 16:47:52 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 16:47:52 user nova-compute[70659]:     </disk>
Jul 25 16:47:52 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:47:52 user nova-compute[70659]:       <mac address="fa:16:3e:c2:a0:42"/>
Jul 25 16:47:52 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:52 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:47:52 user nova-compute[70659]:       <target dev="tapf5aac860-4f"/>
Jul 25 16:47:52 user nova-compute[70659]:     </interface>
Jul 25 16:47:52 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:47:52 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/console.log" append="off"/>
Jul 25 16:47:52 user nova-compute[70659]:     </serial>
Jul 25 16:47:52 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:47:52 user nova-compute[70659]:     <video>
Jul 25 16:47:52 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:47:52 user nova-compute[70659]:     </video>
Jul 25 16:47:52 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:47:52 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:47:52 user nova-compute[70659]:     </rng>
Jul 25 16:47:52 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:47:52 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:47:52 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:47:52 user nova-compute[70659]:     </memballoon>
Jul 25 16:47:52 user nova-compute[70659]:   </devices>
Jul 25 16:47:52 user nova-compute[70659]: </domain>
Jul 25 16:47:52 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:52 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Instance destroyed successfully.
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No VIF found with MAC fa:16:3e:c2:a0:42, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-9e175283-4a83-4f38-9080-78d35fd03ba1 req-69b1253a-7378-4d75-aeae-f07e5293fee4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9e175283-4a83-4f38-9080-78d35fd03ba1 req-69b1253a-7378-4d75-aeae-f07e5293fee4 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9e175283-4a83-4f38-9080-78d35fd03ba1 req-69b1253a-7378-4d75-aeae-f07e5293fee4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9e175283-4a83-4f38-9080-78d35fd03ba1 req-69b1253a-7378-4d75-aeae-f07e5293fee4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-9e175283-4a83-4f38-9080-78d35fd03ba1 req-69b1253a-7378-4d75-aeae-f07e5293fee4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:52 user nova-compute[70659]: WARNING nova.compute.manager [req-9e175283-4a83-4f38-9080-78d35fd03ba1 req-69b1253a-7378-4d75-aeae-f07e5293fee4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 for instance with vm_state building and task_state spawning.
Jul 25 16:47:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-3ab2e3a9-f65f-4f95-98c2-3542cfe7a49e req-4c36153a-b5b0-48bc-a892-7825cab0bde6 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-changed-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-3ab2e3a9-f65f-4f95-98c2-3542cfe7a49e req-4c36153a-b5b0-48bc-a892-7825cab0bde6 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Refreshing instance network info cache due to event network-changed-3c7f2734-73c4-4648-a080-0ea25238dad8. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3ab2e3a9-f65f-4f95-98c2-3542cfe7a49e req-4c36153a-b5b0-48bc-a892-7825cab0bde6 service nova] Acquiring lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3ab2e3a9-f65f-4f95-98c2-3542cfe7a49e req-4c36153a-b5b0-48bc-a892-7825cab0bde6 service nova] Acquired lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.network.neutron [req-3ab2e3a9-f65f-4f95-98c2-3542cfe7a49e req-4c36153a-b5b0-48bc-a892-7825cab0bde6 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Refreshing network info cache for port 3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-0e47bc9f-43f9-4370-b31f-e96285a73aaf req-b1f47a80-34cb-4d87-aadf-8f451950b3c1 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0e47bc9f-43f9-4370-b31f-e96285a73aaf req-b1f47a80-34cb-4d87-aadf-8f451950b3c1 service nova] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0e47bc9f-43f9-4370-b31f-e96285a73aaf req-b1f47a80-34cb-4d87-aadf-8f451950b3c1 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0e47bc9f-43f9-4370-b31f-e96285a73aaf req-b1f47a80-34cb-4d87-aadf-8f451950b3c1 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-0e47bc9f-43f9-4370-b31f-e96285a73aaf req-b1f47a80-34cb-4d87-aadf-8f451950b3c1 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] No waiting events found dispatching network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:52 user nova-compute[70659]: WARNING nova.compute.manager [req-0e47bc9f-43f9-4370-b31f-e96285a73aaf req-b1f47a80-34cb-4d87-aadf-8f451950b3c1 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received unexpected event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b for instance with vm_state active and task_state rescuing.
Jul 25 16:47:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:54 user nova-compute[70659]: WARNING nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 for instance with vm_state building and task_state spawning.
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:54 user nova-compute[70659]: WARNING nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca for instance with vm_state building and task_state spawning.
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:54 user nova-compute[70659]: WARNING nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca for instance with vm_state building and task_state spawning.
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:54 user nova-compute[70659]: WARNING nova.compute.manager [req-02f2cecd-5d06-4d41-b8e1-dfea27ead6dc req-5c930df8-0087-40be-9b48-910117d80d15 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b for instance with vm_state building and task_state spawning.
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-64fb83a9-5901-4396-88f0-29146cf2dbb3 req-7407591d-0508-42ac-b87d-dd1d78d44664 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-changed-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-64fb83a9-5901-4396-88f0-29146cf2dbb3 req-7407591d-0508-42ac-b87d-dd1d78d44664 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Refreshing instance network info cache due to event network-changed-8f746e90-8b94-4b8c-8c13-02df5983ced0. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-64fb83a9-5901-4396-88f0-29146cf2dbb3 req-7407591d-0508-42ac-b87d-dd1d78d44664 service nova] Acquiring lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-64fb83a9-5901-4396-88f0-29146cf2dbb3 req-7407591d-0508-42ac-b87d-dd1d78d44664 service nova] Acquired lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.network.neutron [req-64fb83a9-5901-4396-88f0-29146cf2dbb3 req-7407591d-0508-42ac-b87d-dd1d78d44664 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Refreshing network info cache for port 8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.network.neutron [req-3ab2e3a9-f65f-4f95-98c2-3542cfe7a49e req-4c36153a-b5b0-48bc-a892-7825cab0bde6 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updated VIF entry in instance network info cache for port 3c7f2734-73c4-4648-a080-0ea25238dad8. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG nova.network.neutron [req-3ab2e3a9-f65f-4f95-98c2-3542cfe7a49e req-4c36153a-b5b0-48bc-a892-7825cab0bde6 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updating instance_info_cache with network_info: [{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3ab2e3a9-f65f-4f95-98c2-3542cfe7a49e req-4c36153a-b5b0-48bc-a892-7825cab0bde6 service nova] Releasing lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-c18e7480-7e37-4f48-9324-01000994645c req-ec7136e4-6998-43a6-889d-bdfc1e2a287f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-changed-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-c18e7480-7e37-4f48-9324-01000994645c req-ec7136e4-6998-43a6-889d-bdfc1e2a287f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Refreshing instance network info cache due to event network-changed-219a0a7f-2318-4e5c-b5da-9f9bf813174a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c18e7480-7e37-4f48-9324-01000994645c req-ec7136e4-6998-43a6-889d-bdfc1e2a287f service nova] Acquiring lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c18e7480-7e37-4f48-9324-01000994645c req-ec7136e4-6998-43a6-889d-bdfc1e2a287f service nova] Acquired lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG nova.network.neutron [req-c18e7480-7e37-4f48-9324-01000994645c req-ec7136e4-6998-43a6-889d-bdfc1e2a287f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Refreshing network info cache for port 219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.network.neutron [req-c18e7480-7e37-4f48-9324-01000994645c req-ec7136e4-6998-43a6-889d-bdfc1e2a287f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updated VIF entry in instance network info cache for port 219a0a7f-2318-4e5c-b5da-9f9bf813174a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.network.neutron [req-c18e7480-7e37-4f48-9324-01000994645c req-ec7136e4-6998-43a6-889d-bdfc1e2a287f service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating instance_info_cache with network_info: [{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c18e7480-7e37-4f48-9324-01000994645c req-ec7136e4-6998-43a6-889d-bdfc1e2a287f service nova] Releasing lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.network.neutron [req-64fb83a9-5901-4396-88f0-29146cf2dbb3 req-7407591d-0508-42ac-b87d-dd1d78d44664 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updated VIF entry in instance network info cache for port 8f746e90-8b94-4b8c-8c13-02df5983ced0. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.network.neutron [req-64fb83a9-5901-4396-88f0-29146cf2dbb3 req-7407591d-0508-42ac-b87d-dd1d78d44664 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance_info_cache with network_info: [{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-64fb83a9-5901-4396-88f0-29146cf2dbb3 req-7407591d-0508-42ac-b87d-dd1d78d44664 service nova] Releasing lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:56 user nova-compute[70659]: WARNING nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b for instance with vm_state building and task_state spawning.
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:56 user nova-compute[70659]: WARNING nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef for instance with vm_state building and task_state spawning.
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:56 user nova-compute[70659]: WARNING nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef for instance with vm_state building and task_state spawning.
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:56 user nova-compute[70659]: WARNING nova.compute.manager [req-020efb2c-393f-4e79-b1ab-ec18ac492b97 req-811d5361-ae42-463e-b1de-630c15c561d4 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed for instance with vm_state building and task_state spawning.
Jul 25 16:47:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:57 user nova-compute[70659]: WARNING nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 for instance with vm_state building and task_state spawning.
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:57 user nova-compute[70659]: WARNING nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 for instance with vm_state building and task_state spawning.
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] No waiting events found dispatching network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:57 user nova-compute[70659]: WARNING nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received unexpected event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b for instance with vm_state active and task_state rescuing.
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] No waiting events found dispatching network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:57 user nova-compute[70659]: WARNING nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received unexpected event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b for instance with vm_state active and task_state rescuing.
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:57 user nova-compute[70659]: WARNING nova.compute.manager [req-b796a5ed-de81-4a3a-8019-f4c947fe8d9f req-0f0fa78c-bd79-402f-a762-973369cfdaf2 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-2a328118-fec0-49c6-be72-e9274767e4fb for instance with vm_state building and task_state spawning.
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:57 user nova-compute[70659]: INFO nova.compute.manager [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Attaching volume 142da0f9-710e-45ac-aef3-6ca961bb6c6d to /dev/vdb
Jul 25 16:47:57 user nova-compute[70659]: DEBUG os_brick.utils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1686e2df-6a20-4328-81d3-fe9dfabd7f79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c9067-2262-404e-ac44-a8da6ee72719]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[66476a5c-d8be-4d33-bb27-b3bb47b52306]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f832a2b-89e6-46d0-983a-9ebb92ef47dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:47:57 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:47:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e483cb-d4b8-4039-a1bc-99f9c00bf5d3]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG os_brick.utils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:47:57 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updating existing volume attachment record: e7bd593b-a842-498e-ba84-a4221c2b6206 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxPsZAoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:47:58 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:58 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:47:58 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f869c748-e87e-43b9-876f-cbfbe9a9ac0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:47:58 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecfb933-6bb5-42ed-80b7-ce0708228f64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6] added
Jul 25 16:47:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7674b654-33e2-421c-904e-ccd1bcc51210]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[96414beb-0430-46ee-8547-889c76c51d5f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxPsZAoh {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxPsZAoh" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ca20b1-1d2e-48c1-b784-e00b02dd17e5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yxPsZAoh'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e88f140-1902-454b-8326-a787c48160a4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b999c519-8fa8-4608-91e9-78e5383e50ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.compute.manager [req-5ab426d6-efbd-4f2a-b5b8-66d9ff7e43d3 req-2db20966-7bb7-46a5-bcc7-a34329e12341 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5ab426d6-efbd-4f2a-b5b8-66d9ff7e43d3 req-2db20966-7bb7-46a5-bcc7-a34329e12341 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5ab426d6-efbd-4f2a-b5b8-66d9ff7e43d3 req-2db20966-7bb7-46a5-bcc7-a34329e12341 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5ab426d6-efbd-4f2a-b5b8-66d9ff7e43d3 req-2db20966-7bb7-46a5-bcc7-a34329e12341 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.compute.manager [req-5ab426d6-efbd-4f2a-b5b8-66d9ff7e43d3 req-2db20966-7bb7-46a5-bcc7-a34329e12341 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:58 user nova-compute[70659]: WARNING nova.compute.manager [req-5ab426d6-efbd-4f2a-b5b8-66d9ff7e43d3 req-2db20966-7bb7-46a5-bcc7-a34329e12341 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed for instance with vm_state building and task_state spawning.
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303678.8348927, 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:47:58 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] VM Resumed (Lifecycle Event)
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:47:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance spawned successfully.
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c058e-10f3-4f34-9733-0197f211e8d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6, portal: 172.16.0.220,3260]
Jul 25 16:47:58 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6, portal: 172.16.0.220,3260] successful.
Jul 25 16:47:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303678.8361752, 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:47:58 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] VM Started (Lifecycle Event)
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[49749fbd-69e2-4918-8df5-361d55768412]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fdd83a-23f6-4171-bd3e-1a5061623066]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 (non-flash)
Jul 25 16:47:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:47:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:47:59 user nova-compute[70659]: INFO nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Took 20.86 seconds to spawn the instance on the hypervisor.
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.031s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc97f8b6-0b24-4e45-ae01-03f4b32658e4]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxPsZAoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:47:59 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303679.088552, fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:47:59 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] VM Resumed (Lifecycle Event)
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d2fb483c-9069-4a9a-b1da-24140b64ec07 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:47:59 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303679.170819, fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:47:59 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] VM Started (Lifecycle Event)
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-dabadc10-36cb-49c2-a4a6-2bca3b58f86f req-2b6a82f0-e4b9-49b5-94be-91f990e7c14e service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dabadc10-36cb-49c2-a4a6-2bca3b58f86f req-2b6a82f0-e4b9-49b5-94be-91f990e7c14e service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dabadc10-36cb-49c2-a4a6-2bca3b58f86f req-2b6a82f0-e4b9-49b5-94be-91f990e7c14e service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dabadc10-36cb-49c2-a4a6-2bca3b58f86f req-2b6a82f0-e4b9-49b5-94be-91f990e7c14e service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-dabadc10-36cb-49c2-a4a6-2bca3b58f86f req-2b6a82f0-e4b9-49b5-94be-91f990e7c14e service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:47:59 user nova-compute[70659]: WARNING nova.compute.manager [req-dabadc10-36cb-49c2-a4a6-2bca3b58f86f req-2b6a82f0-e4b9-49b5-94be-91f990e7c14e service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-2a328118-fec0-49c6-be72-e9274767e4fb for instance with vm_state building and task_state spawning.
Jul 25 16:47:59 user nova-compute[70659]: INFO nova.compute.manager [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Took 45.44 seconds to build instance.
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:47:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0441d96e-a590-4483-8fc8-ef61147c523e tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.702s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '23163383036373934', 'path': '/dev/sdh'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163383036373934', 'path': '/dev/sdh'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG nova.objects.instance [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lazy-loading 'flavor' on Instance uuid 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:48:00 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:00 user nova-compute[70659]:   <source dev="/dev/sdh"/>
Jul 25 16:48:00 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:48:00 user nova-compute[70659]:   <serial>7856ad25-95e5-49dd-96ba-b2500bdef0c6</serial>
Jul 25 16:48:00 user nova-compute[70659]: </disk>
Jul 25 16:48:00 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] No VIF found with MAC fa:16:3e:8c:cd:f3, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-267d5866-e98d-4d0f-b5fc-0c5bdbd6cf6d tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.054s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:01 user nova-compute[70659]: INFO nova.compute.manager [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Shelving
Jul 25 16:48:01 user nova-compute[70659]: INFO nova.compute.manager [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Terminating instance
Jul 25 16:48:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "6f6117f9-a000-4491-bd38-b7525298c23a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-9fa94da3-79f4-48ae-a310-ed4581785453 req-101da00c-a557-40da-abe0-a46a4c0d7421 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-unplugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9fa94da3-79f4-48ae-a310-ed4581785453 req-101da00c-a557-40da-abe0-a46a4c0d7421 service nova] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9fa94da3-79f4-48ae-a310-ed4581785453 req-101da00c-a557-40da-abe0-a46a4c0d7421 service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9fa94da3-79f4-48ae-a310-ed4581785453 req-101da00c-a557-40da-abe0-a46a4c0d7421 service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-9fa94da3-79f4-48ae-a310-ed4581785453 req-101da00c-a557-40da-abe0-a46a4c0d7421 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] No waiting events found dispatching network-vif-unplugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:01 user nova-compute[70659]: WARNING nova.compute.manager [req-9fa94da3-79f4-48ae-a310-ed4581785453 req-101da00c-a557-40da-abe0-a46a4c0d7421 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received unexpected event network-vif-unplugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a for instance with vm_state active and task_state shelving.
Jul 25 16:48:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:48:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:48:02 user nova-compute[70659]: INFO nova.compute.claims [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Claim successful on node user
Jul 25 16:48:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-3b01148e-f9ff-45af-8187-99f81cd44b40 req-ed903fee-8de4-46cc-af53-38ec8c94d60e service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received event network-vif-unplugged-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3b01148e-f9ff-45af-8187-99f81cd44b40 req-ed903fee-8de4-46cc-af53-38ec8c94d60e service nova] Acquiring lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3b01148e-f9ff-45af-8187-99f81cd44b40 req-ed903fee-8de4-46cc-af53-38ec8c94d60e service nova] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3b01148e-f9ff-45af-8187-99f81cd44b40 req-ed903fee-8de4-46cc-af53-38ec8c94d60e service nova] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-3b01148e-f9ff-45af-8187-99f81cd44b40 req-ed903fee-8de4-46cc-af53-38ec8c94d60e service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] No waiting events found dispatching network-vif-unplugged-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-3b01148e-f9ff-45af-8187-99f81cd44b40 req-ed903fee-8de4-46cc-af53-38ec8c94d60e service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received event network-vif-unplugged-db56f158-81c9-4a49-a2b7-9849362b8620 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Instance destroyed successfully.
Jul 25 16:48:02 user nova-compute[70659]: DEBUG nova.objects.instance [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lazy-loading 'resources' on Instance uuid 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1789489197',display_name='tempest-DeleteServersTestJSON-server-1789489197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1789489197',id=2,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0039914ee924569ae532f388899d331',ramdisk_id='',reservation_id='r-7xlp09au',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1748001576',owner_user_name='tempest-DeleteServersTestJSON-1748001576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:14Z,user_data=None,user_id='1880545cfe1a4ecf9a3d4e193bb049d5',uuid=7c9ddadf-3e5f-462d-a39d-48078a65b2b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Converting VIF {"id": "db56f158-81c9-4a49-a2b7-9849362b8620", "address": "fa:16:3e:8c:cd:f3", "network": {"id": "06535742-065a-4197-9b49-42325c6db0d3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-793061118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0039914ee924569ae532f388899d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb56f158-81", "ovs_interfaceid": "db56f158-81c9-4a49-a2b7-9849362b8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:cd:f3,bridge_name='br-int',has_traffic_filtering=True,id=db56f158-81c9-4a49-a2b7-9849362b8620,network=Network(06535742-065a-4197-9b49-42325c6db0d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb56f158-81') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG os_vif [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:cd:f3,bridge_name='br-int',has_traffic_filtering=True,id=db56f158-81c9-4a49-a2b7-9849362b8620,network=Network(06535742-065a-4197-9b49-42325c6db0d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb56f158-81') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb56f158-81, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance destroyed successfully.
Jul 25 16:48:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:02 user nova-compute[70659]: INFO os_vif [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:cd:f3,bridge_name='br-int',has_traffic_filtering=True,id=db56f158-81c9-4a49-a2b7-9849362b8620,network=Network(06535742-065a-4197-9b49-42325c6db0d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb56f158-81')
Jul 25 16:48:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxPsZAoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:02 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Beginning cold snapshot process
Jul 25 16:48:02 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e03bb9-a4c2-4f5d-bd0f-176ee7aaa58e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.073s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[697aa778-ce41-4e98-979e-77d03961108b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 (non-flash)
Jul 25 16:48:03 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd3049b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6'): ({'sdh'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Removing single pathed devices sdh {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.061s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8707ad2-c600-4ef7-9879-1e8411ff868c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.036s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.031s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e88aed-db8b-4198-bf1f-8ff884a7358a]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Flushing IO for device /dev/sdh {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b1a29-78bb-4029-aeeb-d68b8031c454]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7231598-c058-4620-8c01-3e0db0e01e3f]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] SCSI volumes sdh have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:48:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.048s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba959115-9f6f-47f9-94d1-84008e587453]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk /opt/stack/data/nova/instances/snapshots/tmp1u4ojkh0/b56c142d5f3a469e84176dbc6a0a57da {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1dafda-9ec7-49bd-aa6c-586764386cff]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6, portal: 172.16.0.220,3260]
Jul 25 16:48:03 user nova-compute[70659]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:03 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.policy [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad466988c34f4e06b5c631b9754db2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa87ca828941408ebb81eb439ebbc79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7856ad25-95e5-49dd-96ba-b2500bdef0c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.059s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbc8751-9bc4-4abb-9a8d-7659d408e6ce]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.574s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] <== disconnect_volume: return (576ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:48:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Deleting instance files /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7_del
Jul 25 16:48:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Deletion of /opt/stack/data/nova/instances/7c9ddadf-3e5f-462d-a39d-48078a65b2b7_del complete
Jul 25 16:48:03 user nova-compute[70659]: INFO nova.virt.block_device [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Booting with volume b5c8d082-5cb7-44e9-b086-4de249762252 at /dev/vda
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70659) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 25 16:48:03 user nova-compute[70659]: INFO nova.virt.libvirt.host [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] UEFI support detected
Jul 25 16:48:03 user nova-compute[70659]: INFO nova.compute.manager [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Took 2.35 seconds to destroy the instance on the hypervisor.
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG os_brick.utils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.089s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[90282a85-49a7-4e60-9ff1-b771838ebb28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.051s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1753fc7-aecc-403c-917f-b7d3ee5d4f43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.252s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[87748229-2494-44f3-b244-3a92bb38cc40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-14596fd3-75e3-48ac-818d-1abd561b0ca6 req-5a3f9758-e094-4763-9ca6-3f3d1235efcf service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-14596fd3-75e3-48ac-818d-1abd561b0ca6 req-5a3f9758-e094-4763-9ca6-3f3d1235efcf service nova] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-14596fd3-75e3-48ac-818d-1abd561b0ca6 req-5a3f9758-e094-4763-9ca6-3f3d1235efcf service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-14596fd3-75e3-48ac-818d-1abd561b0ca6 req-5a3f9758-e094-4763-9ca6-3f3d1235efcf service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-14596fd3-75e3-48ac-818d-1abd561b0ca6 req-5a3f9758-e094-4763-9ca6-3f3d1235efcf service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] No waiting events found dispatching network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:04 user nova-compute[70659]: WARNING nova.compute.manager [req-14596fd3-75e3-48ac-818d-1abd561b0ca6 req-5a3f9758-e094-4763-9ca6-3f3d1235efcf service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received unexpected event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 25 16:48:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f0472b-479d-42b3-8422-e6e3376db162]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:04 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a74859-00c3-418b-ac00-ae538871b951]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG os_brick.utils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] <== get_connector_properties: return (596ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Updating existing volume attachment record: dad89787-6875-4553-8287-3358637f401b {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-8262c0cf-34a2-46f0-bab4-48ec6689148a req-6af95f87-0d8f-45bc-83d1-0c6760b9f2b6 service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received event network-vif-plugged-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8262c0cf-34a2-46f0-bab4-48ec6689148a req-6af95f87-0d8f-45bc-83d1-0c6760b9f2b6 service nova] Acquiring lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8262c0cf-34a2-46f0-bab4-48ec6689148a req-6af95f87-0d8f-45bc-83d1-0c6760b9f2b6 service nova] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8262c0cf-34a2-46f0-bab4-48ec6689148a req-6af95f87-0d8f-45bc-83d1-0c6760b9f2b6 service nova] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-8262c0cf-34a2-46f0-bab4-48ec6689148a req-6af95f87-0d8f-45bc-83d1-0c6760b9f2b6 service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] No waiting events found dispatching network-vif-plugged-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:04 user nova-compute[70659]: WARNING nova.compute.manager [req-8262c0cf-34a2-46f0-bab4-48ec6689148a req-6af95f87-0d8f-45bc-83d1-0c6760b9f2b6 service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received unexpected event network-vif-plugged-db56f158-81c9-4a49-a2b7-9849362b8620 for instance with vm_state active and task_state deleting.
Jul 25 16:48:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk /opt/stack/data/nova/instances/snapshots/tmp1u4ojkh0/b56c142d5f3a469e84176dbc6a0a57da" returned: 0 in 1.081s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Snapshot extracted, beginning image upload
Jul 25 16:48:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Successfully created port: 31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:48:05 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-470c1cc7-ed0a-4443-9ece-eaaec43be2b9 req-1cb22941-3660-4d48-9e5a-ece4a775035f service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Received event network-vif-deleted-db56f158-81c9-4a49-a2b7-9849362b8620 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:05 user nova-compute[70659]: INFO nova.compute.manager [req-470c1cc7-ed0a-4443-9ece-eaaec43be2b9 req-1cb22941-3660-4d48-9e5a-ece4a775035f service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Neutron deleted interface db56f158-81c9-4a49-a2b7-9849362b8620; detaching it from the instance and deleting it from the info cache
Jul 25 16:48:05 user nova-compute[70659]: DEBUG nova.network.neutron [req-470c1cc7-ed0a-4443-9ece-eaaec43be2b9 req-1cb22941-3660-4d48-9e5a-ece4a775035f service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:05 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Took 1.61 seconds to deallocate network for instance.
Jul 25 16:48:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-470c1cc7-ed0a-4443-9ece-eaaec43be2b9 req-1cb22941-3660-4d48-9e5a-ece4a775035f service nova] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Detach interface failed, port_id=db56f158-81c9-4a49-a2b7-9849362b8620, reason: Instance 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:48:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Successfully updated port: 31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "refresh_cache-6f6117f9-a000-4491-bd38-b7525298c23a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquired lock "refresh_cache-6f6117f9-a000-4491-bd38-b7525298c23a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:48:06 user nova-compute[70659]: INFO nova.compute.manager [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Took 1.03 seconds to detach 1 volumes for instance.
Jul 25 16:48:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.007s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-828fe194-874b-4a3b-a21f-cc235b074af3 req-a5d9c12d-0475-4968-9048-310bd945295e service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-changed-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-828fe194-874b-4a3b-a21f-cc235b074af3 req-a5d9c12d-0475-4968-9048-310bd945295e service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Refreshing instance network info cache due to event network-changed-31647377-15e8-4c48-a3f9-0601ae9b7493. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-828fe194-874b-4a3b-a21f-cc235b074af3 req-a5d9c12d-0475-4968-9048-310bd945295e service nova] Acquiring lock "refresh_cache-6f6117f9-a000-4491-bd38-b7525298c23a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Updating instance_info_cache with network_info: [{"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Releasing lock "refresh_cache-6f6117f9-a000-4491-bd38-b7525298c23a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance network_info: |[{"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-828fe194-874b-4a3b-a21f-cc235b074af3 req-a5d9c12d-0475-4968-9048-310bd945295e service nova] Acquired lock "refresh_cache-6f6117f9-a000-4491-bd38-b7525298c23a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-828fe194-874b-4a3b-a21f-cc235b074af3 req-a5d9c12d-0475-4968-9048-310bd945295e service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Refreshing network info cache for port 31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:48:06 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:48:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.660s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:07 user nova-compute[70659]: DEBUG nova.network.neutron [req-828fe194-874b-4a3b-a21f-cc235b074af3 req-a5d9c12d-0475-4968-9048-310bd945295e service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Updated VIF entry in instance network info cache for port 31647377-15e8-4c48-a3f9-0601ae9b7493. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:48:07 user nova-compute[70659]: DEBUG nova.network.neutron [req-828fe194-874b-4a3b-a21f-cc235b074af3 req-a5d9c12d-0475-4968-9048-310bd945295e service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Updating instance_info_cache with network_info: [{"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:07 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Deleted allocations for instance 7c9ddadf-3e5f-462d-a39d-48078a65b2b7
Jul 25 16:48:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-828fe194-874b-4a3b-a21f-cc235b074af3 req-a5d9c12d-0475-4968-9048-310bd945295e service nova] Releasing lock "refresh_cache-6f6117f9-a000-4491-bd38-b7525298c23a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-85cc9809-e8fd-4ffe-a956-e6efad8772ba tempest-DeleteServersTestJSON-1748001576 tempest-DeleteServersTestJSON-1748001576-project-member] Lock "7c9ddadf-3e5f-462d-a39d-48078a65b2b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.324s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gizvkWxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:08 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:08 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:08 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4faf4ca-1e56-4616-93bb-e7b6f9f650b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:48:08 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2be1e2-a460-44cc-b1e0-42612a1c7d6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d] added
Jul 25 16:48:08 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb0686a-db78-4f4c-8e5d-af949d9a2ac5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[88409a23-844b-42a7-b865-c48843ab14f4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gizvkWxB {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gizvkWxB" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3493c0-1a88-47ca-a560-f6a9fc88fca9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gizvkWxB'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[407644b0-1d60-474f-8574-29a76b049d36]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18186c4a-596d-4ea2-a80a-a093de1693ca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:08 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:08 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:08 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Snapshot image upload complete
Jul 25 16:48:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:08 user nova-compute[70659]: INFO nova.compute.manager [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Shelve offloading
Jul 25 16:48:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance destroyed successfully.
Jul 25 16:48:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquired lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating instance_info_cache with network_info: [{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Releasing lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --login" returned: 0 in 1.091s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0545756-5b0f-494e-8408-c59e5927233b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260]
Jul 25 16:48:09 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:09 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed0f02-98cf-477a-a6e4-fd3cfff6500e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[380e071c-6cac-4c3e-aa56-49982c9fcd8d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:09 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:09 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:09 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.380s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fac703-0822-4b9f-9d03-b464e68e094e]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gizvkWxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:48:09 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance destroyed successfully.
Jul 25 16:48:09 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'resources' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-905791245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-905791245',id=6,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOymDjzlIsiz32bRLLU6vehbllh7+WKErUo8ql1bWnzAC3zORdhGDdr8wCoOVTjNchVn98dkc5ViScdVeOVpOsKe6iiUnM/m0wVkj/O7mSoMFcB+Dbqwp/I0fkYoPqM7xA==',key_name='tempest-keypair-37424022',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-xzwkg0n4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member',shelved_at='2023-07-25T16:48:08.323974',shelved_host='user',shelved_image_id='ba71fd72-cd33-4493-b536-539dc1f80bac'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG os_vif [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-50fbe2ae-dbe9-4a13-94db-f2a691ea1d25 req-7a9202c0-7add-4f2f-abad-5222a441b443 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-changed-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-50fbe2ae-dbe9-4a13-94db-f2a691ea1d25 req-7a9202c0-7add-4f2f-abad-5222a441b443 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Refreshing instance network info cache due to event network-changed-219a0a7f-2318-4e5c-b5da-9f9bf813174a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50fbe2ae-dbe9-4a13-94db-f2a691ea1d25 req-7a9202c0-7add-4f2f-abad-5222a441b443 service nova] Acquiring lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50fbe2ae-dbe9-4a13-94db-f2a691ea1d25 req-7a9202c0-7add-4f2f-abad-5222a441b443 service nova] Acquired lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG nova.network.neutron [req-50fbe2ae-dbe9-4a13-94db-f2a691ea1d25 req-7a9202c0-7add-4f2f-abad-5222a441b443 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Refreshing network info cache for port 219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap219a0a7f-23, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:48:09 user nova-compute[70659]: INFO os_vif [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23')
Jul 25 16:48:09 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Deleting instance files /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a_del
Jul 25 16:48:09 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Deletion of /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a_del complete
Jul 25 16:48:09 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Deleted allocations for instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a
Jul 25 16:48:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'numa_topology' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG nova.network.neutron [req-50fbe2ae-dbe9-4a13-94db-f2a691ea1d25 req-7a9202c0-7add-4f2f-abad-5222a441b443 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updated VIF entry in instance network info cache for port 219a0a7f-2318-4e5c-b5da-9f9bf813174a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG nova.network.neutron [req-50fbe2ae-dbe9-4a13-94db-f2a691ea1d25 req-7a9202c0-7add-4f2f-abad-5222a441b443 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating instance_info_cache with network_info: [{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap219a0a7f-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50fbe2ae-dbe9-4a13-94db-f2a691ea1d25 req-7a9202c0-7add-4f2f-abad-5222a441b443 service nova] Releasing lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.425s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== connect_volume: return (2428ms) {'type': 'block', 'scsi_wwn': '23666633534643737', 'path': '/dev/sdh'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666633534643737', 'path': '/dev/sdh'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG nova.objects.instance [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:48:10 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:10 user nova-compute[70659]:   <source dev="/dev/sdh"/>
Jul 25 16:48:10 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:48:10 user nova-compute[70659]:   <serial>142da0f9-710e-45ac-aef3-6ca961bb6c6d</serial>
Jul 25 16:48:10 user nova-compute[70659]: </disk>
Jul 25 16:48:10 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1673085-f2c9-43d6-accd-7083d66f579f tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.318s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No VIF found with MAC fa:16:3e:ea:f3:27, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:48:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-78efeb93-396e-4a83-92e3-21001ecb3c50 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.609s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7951957b-54f2-495c-9f49-e24647e38381 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7951957b-54f2-495c-9f49-e24647e38381 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7951957b-54f2-495c-9f49-e24647e38381 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7951957b-54f2-495c-9f49-e24647e38381 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70659) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7951957b-54f2-495c-9f49-e24647e38381 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-d8733cd7-e29a-4e23-a167-f58283b09535 req-4be8f74a-16cb-4772-98bf-0928a24182e9 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-unplugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d8733cd7-e29a-4e23-a167-f58283b09535 req-4be8f74a-16cb-4772-98bf-0928a24182e9 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d8733cd7-e29a-4e23-a167-f58283b09535 req-4be8f74a-16cb-4772-98bf-0928a24182e9 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d8733cd7-e29a-4e23-a167-f58283b09535 req-4be8f74a-16cb-4772-98bf-0928a24182e9 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-d8733cd7-e29a-4e23-a167-f58283b09535 req-4be8f74a-16cb-4772-98bf-0928a24182e9 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-unplugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:12 user nova-compute[70659]: WARNING nova.compute.manager [req-d8733cd7-e29a-4e23-a167-f58283b09535 req-4be8f74a-16cb-4772-98bf-0928a24182e9 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-unplugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state active and task_state powering-off.
Jul 25 16:48:13 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance destroyed successfully.
Jul 25 16:48:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7951957b-54f2-495c-9f49-e24647e38381 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7951957b-54f2-495c-9f49-e24647e38381 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.955s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-d3034842-2ba5-4c74-bd18-b1b3f86d5a07 req-2f2be788-dc7d-49aa-bb0f-30f01b6657ee service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-changed-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-d3034842-2ba5-4c74-bd18-b1b3f86d5a07 req-2f2be788-dc7d-49aa-bb0f-30f01b6657ee service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Refreshing instance network info cache due to event network-changed-22b9f6ed-8f52-4a52-84e9-098f874d5682. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:48:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d3034842-2ba5-4c74-bd18-b1b3f86d5a07 req-2f2be788-dc7d-49aa-bb0f-30f01b6657ee service nova] Acquiring lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d3034842-2ba5-4c74-bd18-b1b3f86d5a07 req-2f2be788-dc7d-49aa-bb0f-30f01b6657ee service nova] Acquired lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:13 user nova-compute[70659]: DEBUG nova.network.neutron [req-d3034842-2ba5-4c74-bd18-b1b3f86d5a07 req-2f2be788-dc7d-49aa-bb0f-30f01b6657ee service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Refreshing network info cache for port 22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "interface-d437efde-81a8-4be0-b9f8-7a34ee7fea3b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "interface-d437efde-81a8-4be0-b9f8-7a34ee7fea3b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG nova.objects.instance [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lazy-loading 'flavor' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG nova.network.neutron [req-d3034842-2ba5-4c74-bd18-b1b3f86d5a07 req-2f2be788-dc7d-49aa-bb0f-30f01b6657ee service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updated VIF entry in instance network info cache for port 22b9f6ed-8f52-4a52-84e9-098f874d5682. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG nova.network.neutron [req-d3034842-2ba5-4c74-bd18-b1b3f86d5a07 req-2f2be788-dc7d-49aa-bb0f-30f01b6657ee service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updating instance_info_cache with network_info: [{"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d3034842-2ba5-4c74-bd18-b1b3f86d5a07 req-2f2be788-dc7d-49aa-bb0f-30f01b6657ee service nova] Releasing lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG nova.objects.instance [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lazy-loading 'pci_requests' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG nova.network.neutron [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG nova.policy [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3c840bf6c1a438bb2e28e2582e6d7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6ebfc7cdb0435287b8e82062151463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-9fceffcf-f90f-40c6-95ad-7edaebfd4361 req-8585d3d0-8c81-4496-b38a-cd5b476d8b2f service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9fceffcf-f90f-40c6-95ad-7edaebfd4361 req-8585d3d0-8c81-4496-b38a-cd5b476d8b2f service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9fceffcf-f90f-40c6-95ad-7edaebfd4361 req-8585d3d0-8c81-4496-b38a-cd5b476d8b2f service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9fceffcf-f90f-40c6-95ad-7edaebfd4361 req-8585d3d0-8c81-4496-b38a-cd5b476d8b2f service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-9fceffcf-f90f-40c6-95ad-7edaebfd4361 req-8585d3d0-8c81-4496-b38a-cd5b476d8b2f service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:14 user nova-compute[70659]: WARNING nova.compute.manager [req-9fceffcf-f90f-40c6-95ad-7edaebfd4361 req-8585d3d0-8c81-4496-b38a-cd5b476d8b2f service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state stopped and task_state None.
Jul 25 16:48:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:14 user nova-compute[70659]: DEBUG nova.network.neutron [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Successfully created port: 4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:48:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:15 user nova-compute[70659]: DEBUG nova.network.neutron [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Successfully updated port: 4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:48:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquired lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:15 user nova-compute[70659]: DEBUG nova.network.neutron [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.network.neutron [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updating instance_info_cache with network_info: [{"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-70419ef6-2f88-496d-9312-9e9330c41ab8 req-de03cd85-33e6-4446-812d-fd420eedfd3c service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-changed-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-70419ef6-2f88-496d-9312-9e9330c41ab8 req-de03cd85-33e6-4446-812d-fd420eedfd3c service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Refreshing instance network info cache due to event network-changed-4658519b-52aa-4ccb-876e-b834ab7d41b5. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70419ef6-2f88-496d-9312-9e9330c41ab8 req-de03cd85-33e6-4446-812d-fd420eedfd3c service nova] Acquiring lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Releasing lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70419ef6-2f88-496d-9312-9e9330c41ab8 req-de03cd85-33e6-4446-812d-fd420eedfd3c service nova] Acquired lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-70419ef6-2f88-496d-9312-9e9330c41ab8 req-de03cd85-33e6-4446-812d-fd420eedfd3c service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Refreshing network info cache for port 4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1506231380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1506231380',id=8,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASmEG7RFCQFi+1G28n7yNAKzcoCuwcnKcQdXmSbHnxoTEkTop7z5XfU9a4Z/QnRF+riya1mdEECpaqnVJkE7ons8sjRqycUy7lP2+85LLnF913u1TMT3K9a21H+JzyCuw==',key_name='tempest-keypair-1108947464',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c6ebfc7cdb0435287b8e82062151463',ramdisk_id='',reservation_id='r-natyacfd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1788409359',owner_user_name='tempest-TaggedAttachmentsTest-1788409359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c840bf6c1a438bb2e28e2582e6d7fa',uuid=d437efde-81a8-4be0-b9f8-7a34ee7fea3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converting VIF {"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG os_vif [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4658519b-52, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4658519b-52, col_values=(('external_ids', {'iface-id': '4658519b-52aa-4ccb-876e-b834ab7d41b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:15:25', 'vm-uuid': 'd437efde-81a8-4be0-b9f8-7a34ee7fea3b'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:16 user nova-compute[70659]: INFO os_vif [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52')
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1506231380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1506231380',id=8,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASmEG7RFCQFi+1G28n7yNAKzcoCuwcnKcQdXmSbHnxoTEkTop7z5XfU9a4Z/QnRF+riya1mdEECpaqnVJkE7ons8sjRqycUy7lP2+85LLnF913u1TMT3K9a21H+JzyCuw==',key_name='tempest-keypair-1108947464',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c6ebfc7cdb0435287b8e82062151463',ramdisk_id='',reservation_id='r-natyacfd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1788409359',owner_user_name='tempest-TaggedAttachmentsTest-1788409359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c840bf6c1a438bb2e28e2582e6d7fa',uuid=d437efde-81a8-4be0-b9f8-7a34ee7fea3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converting VIF {"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] attach device xml: <interface type="ethernet">
Jul 25 16:48:16 user nova-compute[70659]:   <mac address="fa:16:3e:38:15:25"/>
Jul 25 16:48:16 user nova-compute[70659]:   <model type="virtio"/>
Jul 25 16:48:16 user nova-compute[70659]:   <mtu size="1442"/>
Jul 25 16:48:16 user nova-compute[70659]:   <target dev="tap4658519b-52"/>
Jul 25 16:48:16 user nova-compute[70659]: </interface>
Jul 25 16:48:16 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:48:16 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Creating image(s)
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Ensure instance console log exists: /opt/stack/data/nova/instances/6f6117f9-a000-4491-bd38-b7525298c23a/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Start _get_guest_xml network_info=[{"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dad89787-6875-4553-8287-3358637f401b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFZiMvGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f6117f9-a000-4491-bd38-b7525298c23a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5c8d082-5cb7-44e9-b086-4de249762252', 'serial': 'b5c8d082-5cb7-44e9-b086-4de249762252'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:16 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:48:16 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:48:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:48:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFZiMvGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:17 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:17 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:17 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1459e322-1c35-4e2f-9f26-81343150efbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:48:17 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1181da-9ee5-4ada-92e7-6cdb193e3893]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252] added
Jul 25 16:48:17 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bc6b12-c56c-4ab8-bfb2-5b1f6dd3b68a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef5a08b-fee4-4c95-96aa-ace6562316dd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jFZiMvGq {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jFZiMvGq" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc81681-ffc9-4c88-b607-4b05e710d13b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jFZiMvGq'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[99588785-389a-4537-b849-55212a10e0a5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90ea3cd-a307-44e8-a56f-018d8b8ee505]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:17 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:17 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-4cf4e513-ebfb-49c5-b916-5bc2f333e1a5 req-baddbcba-1a70-4462-b4b8-632094395252 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-plugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4cf4e513-ebfb-49c5-b916-5bc2f333e1a5 req-baddbcba-1a70-4462-b4b8-632094395252 service nova] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4cf4e513-ebfb-49c5-b916-5bc2f333e1a5 req-baddbcba-1a70-4462-b4b8-632094395252 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4cf4e513-ebfb-49c5-b916-5bc2f333e1a5 req-baddbcba-1a70-4462-b4b8-632094395252 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-4cf4e513-ebfb-49c5-b916-5bc2f333e1a5 req-baddbcba-1a70-4462-b4b8-632094395252 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] No waiting events found dispatching network-vif-plugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:17 user nova-compute[70659]: WARNING nova.compute.manager [req-4cf4e513-ebfb-49c5-b916-5bc2f333e1a5 req-baddbcba-1a70-4462-b4b8-632094395252 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received unexpected event network-vif-plugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 for instance with vm_state active and task_state None.
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] No BDM found with device name hda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] No VIF found with MAC fa:16:3e:75:35:58, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:48:17 user nova-compute[70659]:   <nova:package version="0.0.0"/>
Jul 25 16:48:17 user nova-compute[70659]:   <nova:name>tempest-device-tagging-server-1506231380</nova:name>
Jul 25 16:48:17 user nova-compute[70659]:   <nova:creationTime>2023-07-25 16:48:17</nova:creationTime>
Jul 25 16:48:17 user nova-compute[70659]:   <nova:flavor name="m1.tiny">
Jul 25 16:48:17 user nova-compute[70659]:     <nova:memory>512</nova:memory>
Jul 25 16:48:17 user nova-compute[70659]:     <nova:disk>1</nova:disk>
Jul 25 16:48:17 user nova-compute[70659]:     <nova:swap>0</nova:swap>
Jul 25 16:48:17 user nova-compute[70659]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:48:17 user nova-compute[70659]:     <nova:vcpus>1</nova:vcpus>
Jul 25 16:48:17 user nova-compute[70659]:   </nova:flavor>
Jul 25 16:48:17 user nova-compute[70659]:   <nova:owner>
Jul 25 16:48:17 user nova-compute[70659]:     <nova:user uuid="c3c840bf6c1a438bb2e28e2582e6d7fa">tempest-TaggedAttachmentsTest-1788409359-project-member</nova:user>
Jul 25 16:48:17 user nova-compute[70659]:     <nova:project uuid="0c6ebfc7cdb0435287b8e82062151463">tempest-TaggedAttachmentsTest-1788409359</nova:project>
Jul 25 16:48:17 user nova-compute[70659]:   </nova:owner>
Jul 25 16:48:17 user nova-compute[70659]:   <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:48:17 user nova-compute[70659]:   <nova:ports>
Jul 25 16:48:17 user nova-compute[70659]:     <nova:port uuid="22b9f6ed-8f52-4a52-84e9-098f874d5682">
Jul 25 16:48:17 user nova-compute[70659]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:48:17 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:17 user nova-compute[70659]:     <nova:port uuid="4658519b-52aa-4ccb-876e-b834ab7d41b5">
Jul 25 16:48:17 user nova-compute[70659]:       <nova:ip type="fixed" address="10.10.10.104" ipVersion="4"/>
Jul 25 16:48:17 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:17 user nova-compute[70659]:   </nova:ports>
Jul 25 16:48:17 user nova-compute[70659]: </nova:instance>
Jul 25 16:48:17 user nova-compute[70659]:  {{(pid=70659) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8582b9b-b734-4e50-89ae-34e77b01c52b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260]
Jul 25 16:48:17 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:17 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-70419ef6-2f88-496d-9312-9e9330c41ab8 req-de03cd85-33e6-4446-812d-fd420eedfd3c service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updated VIF entry in instance network info cache for port 4658519b-52aa-4ccb-876e-b834ab7d41b5. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-70419ef6-2f88-496d-9312-9e9330c41ab8 req-de03cd85-33e6-4446-812d-fd420eedfd3c service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updating instance_info_cache with network_info: [{"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f3c4c00e-2800-49ab-96a8-5f4e9122dcc0 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "interface-d437efde-81a8-4be0-b9f8-7a34ee7fea3b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.450s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.100s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16f5e96-8ba4-4878-8155-a667230c1d37]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70419ef6-2f88-496d-9312-9e9330c41ab8 req-de03cd85-33e6-4446-812d-fd420eedfd3c service nova] Releasing lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fe77a9-bf4a-491b-9969-1f5b623ee09e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:17 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:17 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:17 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.484s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f7ff16-b47c-405b-bcf5-8f185d1c307d]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFZiMvGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303682.7662067, 7c9ddadf-3e5f-462d-a39d-48078a65b2b7 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:48:17 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] VM Stopped (Lifecycle Event)
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303682.7848575, 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:48:17 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] VM Stopped (Lifecycle Event)
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e56af395-cf55-4eef-887c-5625e77f361e None None] [instance: 7c9ddadf-3e5f-462d-a39d-48078a65b2b7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c159ac96-4af6-47dc-afb1-24b49dc0b584 None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lazy-loading 'flavor' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:18 user nova-compute[70659]: INFO nova.compute.manager [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Attaching volume 1a671a03-23b8-4531-94c7-7ed90b08778b to /dev/vdb
Jul 25 16:48:18 user nova-compute[70659]: DEBUG os_brick.utils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c586e5a5-7595-4bb5-9c78-6076c9c028a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324ff99-e778-4fb0-afd5-475b52404cbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd35eac2-6833-4c74-9120-149f65c23c68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4303c80a-6568-4f41-9080-070b2a64e50a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:18 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:48:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ac531a-16b7-4d21-abc0-fed259d46d8e]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG os_brick.utils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updating existing volume attachment record: b84b8421-b1b1-49b8-9016-6db501a721a5 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] <== connect_volume: return (1540ms) {'type': 'block', 'scsi_wwn': '23865333961303265', 'path': '/dev/sdi'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865333961303265', 'path': '/dev/sdi'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1510861238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1510861238',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdrrnEIsPtiOyPXZwZDkWWdRWRmg5eRltyImohYN5f/QNID4CDxf10xSW043jjUbCODnxMzL1McqL4p/4z9m7F1bT8oACH9CMyevg1NsoxnXEziUsCowS7fJm1RWMTB9A==',key_name='tempest-keypair-1581675553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa87ca828941408ebb81eb439ebbc79e',ramdisk_id='',reservation_id='r-66ri7r0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-510925623',owner_user_name='tempest-ServerActionsV293TestJSON-510925623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad466988c34f4e06b5c631b9754db2c5',uuid=6f6117f9-a000-4491-bd38-b7525298c23a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converting VIF {"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.objects.instance [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f6117f9-a000-4491-bd38-b7525298c23a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:48:18 user nova-compute[70659]:   <uuid>6f6117f9-a000-4491-bd38-b7525298c23a</uuid>
Jul 25 16:48:18 user nova-compute[70659]:   <name>instance-0000000d</name>
Jul 25 16:48:18 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:48:18 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:48:18 user nova-compute[70659]:   <metadata>
Jul 25 16:48:18 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:48:18 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:48:18 user nova-compute[70659]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1510861238</nova:name>
Jul 25 16:48:18 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:48:16</nova:creationTime>
Jul 25 16:48:18 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:48:18 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:48:18 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:48:18 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:48:18 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:48:18 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:48:18 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:48:18 user nova-compute[70659]:       <nova:owner>
Jul 25 16:48:18 user nova-compute[70659]:         <nova:user uuid="ad466988c34f4e06b5c631b9754db2c5">tempest-ServerActionsV293TestJSON-510925623-project-member</nova:user>
Jul 25 16:48:18 user nova-compute[70659]:         <nova:project uuid="fa87ca828941408ebb81eb439ebbc79e">tempest-ServerActionsV293TestJSON-510925623</nova:project>
Jul 25 16:48:18 user nova-compute[70659]:       </nova:owner>
Jul 25 16:48:18 user nova-compute[70659]:       <nova:ports>
Jul 25 16:48:18 user nova-compute[70659]:         <nova:port uuid="31647377-15e8-4c48-a3f9-0601ae9b7493">
Jul 25 16:48:18 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:48:18 user nova-compute[70659]:         </nova:port>
Jul 25 16:48:18 user nova-compute[70659]:       </nova:ports>
Jul 25 16:48:18 user nova-compute[70659]:     </nova:instance>
Jul 25 16:48:18 user nova-compute[70659]:   </metadata>
Jul 25 16:48:18 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:48:18 user nova-compute[70659]:     <system>
Jul 25 16:48:18 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:48:18 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:48:18 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:48:18 user nova-compute[70659]:       <entry name="serial">6f6117f9-a000-4491-bd38-b7525298c23a</entry>
Jul 25 16:48:18 user nova-compute[70659]:       <entry name="uuid">6f6117f9-a000-4491-bd38-b7525298c23a</entry>
Jul 25 16:48:18 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:48:18 user nova-compute[70659]:     </system>
Jul 25 16:48:18 user nova-compute[70659]:   </sysinfo>
Jul 25 16:48:18 user nova-compute[70659]:   <os>
Jul 25 16:48:18 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:48:18 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:48:18 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:48:18 user nova-compute[70659]:   </os>
Jul 25 16:48:18 user nova-compute[70659]:   <features>
Jul 25 16:48:18 user nova-compute[70659]:     <acpi/>
Jul 25 16:48:18 user nova-compute[70659]:     <apic/>
Jul 25 16:48:18 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:48:18 user nova-compute[70659]:   </features>
Jul 25 16:48:18 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:48:18 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:48:18 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:48:18 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:48:18 user nova-compute[70659]:   </clock>
Jul 25 16:48:18 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:48:18 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:48:18 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:48:18 user nova-compute[70659]:   </cpu>
Jul 25 16:48:18 user nova-compute[70659]:   <devices>
Jul 25 16:48:18 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:48:18 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:18 user nova-compute[70659]:       <source dev="/dev/sdi"/>
Jul 25 16:48:18 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:48:18 user nova-compute[70659]:       <serial>b5c8d082-5cb7-44e9-b086-4de249762252</serial>
Jul 25 16:48:18 user nova-compute[70659]:     </disk>
Jul 25 16:48:18 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:48:18 user nova-compute[70659]:       <mac address="fa:16:3e:39:7b:c1"/>
Jul 25 16:48:18 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:48:18 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:48:18 user nova-compute[70659]:       <target dev="tap31647377-15"/>
Jul 25 16:48:18 user nova-compute[70659]:     </interface>
Jul 25 16:48:18 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:48:18 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/6f6117f9-a000-4491-bd38-b7525298c23a/console.log" append="off"/>
Jul 25 16:48:18 user nova-compute[70659]:     </serial>
Jul 25 16:48:18 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:48:18 user nova-compute[70659]:     <video>
Jul 25 16:48:18 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:48:18 user nova-compute[70659]:     </video>
Jul 25 16:48:18 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:48:18 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:48:18 user nova-compute[70659]:     </rng>
Jul 25 16:48:18 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:48:18 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:48:18 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:48:18 user nova-compute[70659]:     </memballoon>
Jul 25 16:48:18 user nova-compute[70659]:   </devices>
Jul 25 16:48:18 user nova-compute[70659]: </domain>
Jul 25 16:48:18 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1510861238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1510861238',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdrrnEIsPtiOyPXZwZDkWWdRWRmg5eRltyImohYN5f/QNID4CDxf10xSW043jjUbCODnxMzL1McqL4p/4z9m7F1bT8oACH9CMyevg1NsoxnXEziUsCowS7fJm1RWMTB9A==',key_name='tempest-keypair-1581675553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa87ca828941408ebb81eb439ebbc79e',ramdisk_id='',reservation_id='r-66ri7r0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-510925623',owner_user_name='tempest-ServerActionsV293TestJSON-510925623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad466988c34f4e06b5c631b9754db2c5',uuid=6f6117f9-a000-4491-bd38-b7525298c23a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converting VIF {"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG os_vif [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31647377-15, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31647377-15, col_values=(('external_ids', {'iface-id': '31647377-15e8-4c48-a3f9-0601ae9b7493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:7b:c1', 'vm-uuid': '6f6117f9-a000-4491-bd38-b7525298c23a'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:18 user nova-compute[70659]: INFO os_vif [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15')
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] No VIF found with MAC fa:16:3e:39:7b:c1, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:48:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac635011-f166-4efc-a2f5-91321b32e72d req-eb12f402-545f-4a4a-8b5c-c9b5ec4e6535 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-plugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac635011-f166-4efc-a2f5-91321b32e72d req-eb12f402-545f-4a4a-8b5c-c9b5ec4e6535 service nova] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac635011-f166-4efc-a2f5-91321b32e72d req-eb12f402-545f-4a4a-8b5c-c9b5ec4e6535 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac635011-f166-4efc-a2f5-91321b32e72d req-eb12f402-545f-4a4a-8b5c-c9b5ec4e6535 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac635011-f166-4efc-a2f5-91321b32e72d req-eb12f402-545f-4a4a-8b5c-c9b5ec4e6535 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] No waiting events found dispatching network-vif-plugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:19 user nova-compute[70659]: WARNING nova.compute.manager [req-ac635011-f166-4efc-a2f5-91321b32e72d req-eb12f402-545f-4a4a-8b5c-c9b5ec4e6535 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received unexpected event network-vif-plugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 for instance with vm_state active and task_state None.
Jul 25 16:48:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] No waiting events found dispatching network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:21 user nova-compute[70659]: WARNING nova.compute.manager [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received unexpected event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 for instance with vm_state building and task_state spawning.
Jul 25 16:48:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] No waiting events found dispatching network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:21 user nova-compute[70659]: WARNING nova.compute.manager [req-54955c56-7b01-4064-b7f2-deea7c4c698f req-625e1e9f-6f17-4b8b-bf99-7cc540119725 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received unexpected event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 for instance with vm_state building and task_state spawning.
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303702.3469558, 6f6117f9-a000-4491-bd38-b7525298c23a => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:48:22 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] VM Resumed (Lifecycle Event)
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:48:22 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance spawned successfully.
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:48:22 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303702.3854365, 6f6117f9-a000-4491-bd38-b7525298c23a => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:48:22 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] VM Started (Lifecycle Event)
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:48:22 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:48:22 user nova-compute[70659]: INFO nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Took 5.63 seconds to spawn the instance on the hypervisor.
Jul 25 16:48:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:22 user nova-compute[70659]: INFO nova.compute.manager [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Took 20.61 seconds to build instance.
Jul 25 16:48:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bd193219-1d5a-423e-99ec-fac49c5678e6 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "6f6117f9-a000-4491-bd38-b7525298c23a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.805s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-38f7a0c2-9461-41fb-bea3-b81ceeae3e6c req-92513008-936b-4bf6-8480-2f9c5cf976bb service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received event network-changed-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-38f7a0c2-9461-41fb-bea3-b81ceeae3e6c req-92513008-936b-4bf6-8480-2f9c5cf976bb service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Refreshing instance network info cache due to event network-changed-b6b068df-7e92-4f25-b964-6c3492bcd6ec. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:48:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-38f7a0c2-9461-41fb-bea3-b81ceeae3e6c req-92513008-936b-4bf6-8480-2f9c5cf976bb service nova] Acquiring lock "refresh_cache-7d47d257-3a12-48d8-bdb1-adec83869c41" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-38f7a0c2-9461-41fb-bea3-b81ceeae3e6c req-92513008-936b-4bf6-8480-2f9c5cf976bb service nova] Acquired lock "refresh_cache-7d47d257-3a12-48d8-bdb1-adec83869c41" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-38f7a0c2-9461-41fb-bea3-b81ceeae3e6c req-92513008-936b-4bf6-8480-2f9c5cf976bb service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Refreshing network info cache for port b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:48:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-38f7a0c2-9461-41fb-bea3-b81ceeae3e6c req-92513008-936b-4bf6-8480-2f9c5cf976bb service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Updated VIF entry in instance network info cache for port b6b068df-7e92-4f25-b964-6c3492bcd6ec. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:48:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-38f7a0c2-9461-41fb-bea3-b81ceeae3e6c req-92513008-936b-4bf6-8480-2f9c5cf976bb service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Updating instance_info_cache with network_info: [{"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-38f7a0c2-9461-41fb-bea3-b81ceeae3e6c req-92513008-936b-4bf6-8480-2f9c5cf976bb service nova] Releasing lock "refresh_cache-7d47d257-3a12-48d8-bdb1-adec83869c41" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lazy-loading 'flavor' on Instance uuid 98c0757f-7146-48ea-ac36-e7c107e74d73 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:25 user nova-compute[70659]: INFO nova.compute.manager [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Attaching volume 4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 to /dev/vdb
Jul 25 16:48:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-e0bd1126-1e96-462e-ae7d-71edd63e77e7 req-f03c2e54-0e3e-47ae-b757-16a81e9b8fbc service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received event network-changed-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-e0bd1126-1e96-462e-ae7d-71edd63e77e7 req-f03c2e54-0e3e-47ae-b757-16a81e9b8fbc service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Refreshing instance network info cache due to event network-changed-e09bb48a-aed2-4377-9b1b-cfbd077068ec. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e0bd1126-1e96-462e-ae7d-71edd63e77e7 req-f03c2e54-0e3e-47ae-b757-16a81e9b8fbc service nova] Acquiring lock "refresh_cache-98c0757f-7146-48ea-ac36-e7c107e74d73" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e0bd1126-1e96-462e-ae7d-71edd63e77e7 req-f03c2e54-0e3e-47ae-b757-16a81e9b8fbc service nova] Acquired lock "refresh_cache-98c0757f-7146-48ea-ac36-e7c107e74d73" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-e0bd1126-1e96-462e-ae7d-71edd63e77e7 req-f03c2e54-0e3e-47ae-b757-16a81e9b8fbc service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Refreshing network info cache for port e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG os_brick.utils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f29daed-757d-4164-a36f-870841c11508]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad948f5c-7ac2-4a43-8171-84dbe7c70f86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca81a6-5e91-4995-a137-1c0382849cd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1821aa-4559-4efe-a218-eb940595b87f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:25 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:48:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc677a8-6b61-4fc8-b82e-9b8b102e26a9]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG os_brick.utils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Updating existing volume attachment record: f543b06e-645d-443d-9940-e4d8fc155238 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:48:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:26 user nova-compute[70659]: DEBUG nova.network.neutron [req-e0bd1126-1e96-462e-ae7d-71edd63e77e7 req-f03c2e54-0e3e-47ae-b757-16a81e9b8fbc service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Updated VIF entry in instance network info cache for port e09bb48a-aed2-4377-9b1b-cfbd077068ec. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:48:26 user nova-compute[70659]: DEBUG nova.network.neutron [req-e0bd1126-1e96-462e-ae7d-71edd63e77e7 req-f03c2e54-0e3e-47ae-b757-16a81e9b8fbc service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Updating instance_info_cache with network_info: [{"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e0bd1126-1e96-462e-ae7d-71edd63e77e7 req-f03c2e54-0e3e-47ae-b757-16a81e9b8fbc service nova] Releasing lock "refresh_cache-98c0757f-7146-48ea-ac36-e7c107e74d73" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:28 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303693.0213125, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:48:28 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] VM Stopped (Lifecycle Event)
Jul 25 16:48:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-447e9a4a-ecac-42c0-a430-0d2c915aab2f None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:48:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-447e9a4a-ecac-42c0-a430-0d2c915aab2f None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:48:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:48:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FACptSMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:28 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:29 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:29 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[817c486d-2c58-40fa-9c2a-4e58bfc66271]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:48:29 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5161f3a0-4f89-40fe-9fdc-6936f89e2706]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b] added
Jul 25 16:48:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[977c53e4-1e47-4386-ba99-84155f61d487]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a18718-4dba-48a6-b51a-a1d6a02feb9d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FACptSMy {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FACptSMy" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8976511-ed03-44f3-a07f-5b86e9a6fb85]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FACptSMy'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a702e37-6e2c-4e5e-91c8-e254f25d055f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2d5dc5-2457-4edb-bf51-dc570a0a0cda]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5540be89-b181-4950-840f-e7bb7e6d12b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b, portal: 172.16.0.220,3260]
Jul 25 16:48:29 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f62628b-c56d-47c9-a5cb-7ea0216ea8ab]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8a010f-c3ae-497d-8266-cc65d0863f57]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:29 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[92832652-29cf-439a-b6f0-579ff40d1a14]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FACptSMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG nova.objects.instance [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lazy-loading 'flavor' on Instance uuid 7d47d257-3a12-48d8-bdb1-adec83869c41 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:29 user nova-compute[70659]: INFO nova.compute.manager [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Attaching volume 658d3963-c40e-4570-8ff3-6c3d03d6c15b to /dev/sdc
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.utils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf586c6-30fe-4117-921c-512b44203231]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[13471495-79d1-43e9-ab7d-34d78002dcdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a81e8a-314c-4837-94a3-90d9ae7f5c5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d5504e-a916-479a-a1d3-bd21ec3c3510]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:29 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:48:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c61da1-4178-4cc5-acf4-7b1b10b62f1e]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG os_brick.utils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:29 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Updating existing volume attachment record: 37c91bec-f27d-4986-a7fa-a706178c89f8 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:48:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23436653232623938', 'path': '/dev/sdk'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436653232623938', 'path': '/dev/sdk'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:48:30 user nova-compute[70659]: DEBUG nova.objects.instance [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lazy-loading 'flavor' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:48:30 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:30 user nova-compute[70659]:   <source dev="/dev/sdk"/>
Jul 25 16:48:30 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:48:30 user nova-compute[70659]:   <serial>1a671a03-23b8-4531-94c7-7ed90b08778b</serial>
Jul 25 16:48:30 user nova-compute[70659]: </disk>
Jul 25 16:48:30 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:48:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] No BDM found with device name hda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] No VIF found with MAC fa:16:3e:75:35:58, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:48:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-761b12a3-7d63-4ff1-972f-d23f657ebe0a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.972s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:33 user nova-compute[70659]: INFO nova.compute.manager [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Detaching volume 1a671a03-23b8-4531-94c7-7ed90b08778b
Jul 25 16:48:33 user nova-compute[70659]: INFO nova.virt.block_device [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Attempting to driver detach volume 1a671a03-23b8-4531-94c7-7ed90b08778b from mountpoint /dev/vdb
Jul 25 16:48:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Attempting to detach device vdb from instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:48:33 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:33 user nova-compute[70659]:   <source dev="/dev/sdk"/>
Jul 25 16:48:33 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:48:33 user nova-compute[70659]:   <serial>1a671a03-23b8-4531-94c7-7ed90b08778b</serial>
Jul 25 16:48:33 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 16:48:33 user nova-compute[70659]: </disk>
Jul 25 16:48:33 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:48:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Successfully detached device vdb from instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b from the persistent domain config.
Jul 25 16:48:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:48:33 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:33 user nova-compute[70659]:   <source dev="/dev/sdk"/>
Jul 25 16:48:33 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:48:33 user nova-compute[70659]:   <serial>1a671a03-23b8-4531-94c7-7ed90b08778b</serial>
Jul 25 16:48:33 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 16:48:33 user nova-compute[70659]: </disk>
Jul 25 16:48:33 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690303713.690683, d437efde-81a8-4be0-b9f8-7a34ee7fea3b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:48:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Successfully detached device vdb from instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b from the live domain config.
Jul 25 16:48:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FACptSMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:33 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca4007-c3d4-4f4c-af68-06552b70fc48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[330b3b8d-1b37-4d29-b07f-e0cd3e30a30f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:33 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:33 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:33 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd301f3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b'): ({'sdk'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Removing single pathed devices sdk {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc43b10-1c9e-452d-81d6-02bd6b4764f6]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a96d60-de8b-41f4-ab10-f94e4f4329a6]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Flushing IO for device /dev/sdk {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e4b7ce-b740-4305-8c5d-214d6954f27c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.053s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8bc4c-9865-4416-9262-8d8c4c75d8cc]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] SCSI volumes sdk have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62aafeb-ad44-4f0e-8dbf-ab40f240d7aa]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[768a0cc9-56c5-49e2-99e0-6a93d00bd856]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b, portal: 172.16.0.220,3260]
Jul 25 16:48:34 user nova-compute[70659]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:34 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a671a03-23b8-4531-94c7-7ed90b08778b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eab2d6-36dc-451a-918a-df1aedc560cd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] <== disconnect_volume: return (377ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lazy-loading 'flavor' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9c1617d3-31f7-48c4-90ee-8c84a2fc8cbf tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.148s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "interface-d437efde-81a8-4be0-b9f8-7a34ee7fea3b-4658519b-52aa-4ccb-876e-b834ab7d41b5" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "interface-d437efde-81a8-4be0-b9f8-7a34ee7fea3b-4658519b-52aa-4ccb-876e-b834ab7d41b5" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.objects.instance [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lazy-loading 'flavor' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1506231380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1506231380',id=8,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASmEG7RFCQFi+1G28n7yNAKzcoCuwcnKcQdXmSbHnxoTEkTop7z5XfU9a4Z/QnRF+riya1mdEECpaqnVJkE7ons8sjRqycUy7lP2+85LLnF913u1TMT3K9a21H+JzyCuw==',key_name='tempest-keypair-1108947464',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c6ebfc7cdb0435287b8e82062151463',ramdisk_id='',reservation_id='r-natyacfd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1788409359',owner_user_name='tempest-TaggedAttachmentsTest-1788409359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c840bf6c1a438bb2e28e2582e6d7fa',uuid=d437efde-81a8-4be0-b9f8-7a34ee7fea3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converting VIF {"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface> {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface> {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Attempting to detach device tap4658519b-52 from instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] detach device xml: <interface type="ethernet">
Jul 25 16:48:35 user nova-compute[70659]:   <mac address="fa:16:3e:38:15:25"/>
Jul 25 16:48:35 user nova-compute[70659]:   <model type="virtio"/>
Jul 25 16:48:35 user nova-compute[70659]:   <mtu size="1442"/>
Jul 25 16:48:35 user nova-compute[70659]:   <target dev="tap4658519b-52"/>
Jul 25 16:48:35 user nova-compute[70659]: </interface>
Jul 25 16:48:35 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface> {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 25 16:48:35 user nova-compute[70659]:   <name>instance-00000008</name>
Jul 25 16:48:35 user nova-compute[70659]:   <uuid>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</uuid>
Jul 25 16:48:35 user nova-compute[70659]:   <metadata>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:48:35 user nova-compute[70659]:   <nova:package version="0.0.0"/>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:name>tempest-device-tagging-server-1506231380</nova:name>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:creationTime>2023-07-25 16:48:17</nova:creationTime>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:flavor name="m1.tiny">
Jul 25 16:48:35 user nova-compute[70659]:     <nova:memory>512</nova:memory>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:disk>1</nova:disk>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:swap>0</nova:swap>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:vcpus>1</nova:vcpus>
Jul 25 16:48:35 user nova-compute[70659]:   </nova:flavor>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:owner>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:user uuid="c3c840bf6c1a438bb2e28e2582e6d7fa">tempest-TaggedAttachmentsTest-1788409359-project-member</nova:user>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:project uuid="0c6ebfc7cdb0435287b8e82062151463">tempest-TaggedAttachmentsTest-1788409359</nova:project>
Jul 25 16:48:35 user nova-compute[70659]:   </nova:owner>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:ports>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:port uuid="22b9f6ed-8f52-4a52-84e9-098f874d5682">
Jul 25 16:48:35 user nova-compute[70659]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:48:35 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:port uuid="4658519b-52aa-4ccb-876e-b834ab7d41b5">
Jul 25 16:48:35 user nova-compute[70659]:       <nova:ip type="fixed" address="10.10.10.104" ipVersion="4"/>
Jul 25 16:48:35 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:35 user nova-compute[70659]:   </nova:ports>
Jul 25 16:48:35 user nova-compute[70659]: </nova:instance>
Jul 25 16:48:35 user nova-compute[70659]:   </metadata>
Jul 25 16:48:35 user nova-compute[70659]:   <memory unit='KiB'>524288</memory>
Jul 25 16:48:35 user nova-compute[70659]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 16:48:35 user nova-compute[70659]:   <vcpu placement='static'>1</vcpu>
Jul 25 16:48:35 user nova-compute[70659]:   <resource>
Jul 25 16:48:35 user nova-compute[70659]:     <partition>/machine</partition>
Jul 25 16:48:35 user nova-compute[70659]:   </resource>
Jul 25 16:48:35 user nova-compute[70659]:   <sysinfo type='smbios'>
Jul 25 16:48:35 user nova-compute[70659]:     <system>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='version'>0.0.0</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='serial'>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='uuid'>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='family'>Virtual Machine</entry>
Jul 25 16:48:35 user nova-compute[70659]:     </system>
Jul 25 16:48:35 user nova-compute[70659]:   </sysinfo>
Jul 25 16:48:35 user nova-compute[70659]:   <os>
Jul 25 16:48:35 user nova-compute[70659]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 16:48:35 user nova-compute[70659]:     <boot dev='hd'/>
Jul 25 16:48:35 user nova-compute[70659]:     <smbios mode='sysinfo'/>
Jul 25 16:48:35 user nova-compute[70659]:   </os>
Jul 25 16:48:35 user nova-compute[70659]:   <features>
Jul 25 16:48:35 user nova-compute[70659]:     <acpi/>
Jul 25 16:48:35 user nova-compute[70659]:     <apic/>
Jul 25 16:48:35 user nova-compute[70659]:     <vmcoreinfo state='on'/>
Jul 25 16:48:35 user nova-compute[70659]:   </features>
Jul 25 16:48:35 user nova-compute[70659]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 16:48:35 user nova-compute[70659]:     <model fallback='forbid'>Nehalem</model>
Jul 25 16:48:35 user nova-compute[70659]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 16:48:35 user nova-compute[70659]:     <feature policy='require' name='vme'/>
Jul 25 16:48:35 user nova-compute[70659]:     <feature policy='require' name='x2apic'/>
Jul 25 16:48:35 user nova-compute[70659]:     <feature policy='require' name='hypervisor'/>
Jul 25 16:48:35 user nova-compute[70659]:   </cpu>
Jul 25 16:48:35 user nova-compute[70659]:   <clock offset='utc'>
Jul 25 16:48:35 user nova-compute[70659]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 16:48:35 user nova-compute[70659]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 16:48:35 user nova-compute[70659]:     <timer name='hpet' present='no'/>
Jul 25 16:48:35 user nova-compute[70659]:   </clock>
Jul 25 16:48:35 user nova-compute[70659]:   <on_poweroff>destroy</on_poweroff>
Jul 25 16:48:35 user nova-compute[70659]:   <on_reboot>restart</on_reboot>
Jul 25 16:48:35 user nova-compute[70659]:   <on_crash>destroy</on_crash>
Jul 25 16:48:35 user nova-compute[70659]:   <devices>
Jul 25 16:48:35 user nova-compute[70659]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 16:48:35 user nova-compute[70659]:     <disk type='file' device='disk'>
Jul 25 16:48:35 user nova-compute[70659]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 16:48:35 user nova-compute[70659]:       <source file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk' index='2'/>
Jul 25 16:48:35 user nova-compute[70659]:       <backingStore type='file' index='3'>
Jul 25 16:48:35 user nova-compute[70659]:         <format type='raw'/>
Jul 25 16:48:35 user nova-compute[70659]:         <source file='/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261'/>
Jul 25 16:48:35 user nova-compute[70659]:         <backingStore/>
Jul 25 16:48:35 user nova-compute[70659]:       </backingStore>
Jul 25 16:48:35 user nova-compute[70659]:       <target dev='vda' bus='virtio'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='virtio-disk0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </disk>
Jul 25 16:48:35 user nova-compute[70659]:     <disk type='file' device='cdrom'>
Jul 25 16:48:35 user nova-compute[70659]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 16:48:35 user nova-compute[70659]:       <source file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.config' index='1'/>
Jul 25 16:48:35 user nova-compute[70659]:       <backingStore/>
Jul 25 16:48:35 user nova-compute[70659]:       <target dev='hda' bus='ide'/>
Jul 25 16:48:35 user nova-compute[70659]:       <readonly/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='ide0-0-0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </disk>
Jul 25 16:48:35 user nova-compute[70659]:     <controller type='usb' index='0' model='none'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='usb'/>
Jul 25 16:48:35 user nova-compute[70659]:     </controller>
Jul 25 16:48:35 user nova-compute[70659]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='pci.0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </controller>
Jul 25 16:48:35 user nova-compute[70659]:     <controller type='ide' index='0'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='ide'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 16:48:35 user nova-compute[70659]:     </controller>
Jul 25 16:48:35 user nova-compute[70659]:     <interface type='ethernet'>
Jul 25 16:48:35 user nova-compute[70659]:       <mac address='fa:16:3e:75:35:58'/>
Jul 25 16:48:35 user nova-compute[70659]:       <target dev='tap22b9f6ed-8f'/>
Jul 25 16:48:35 user nova-compute[70659]:       <model type='virtio'/>
Jul 25 16:48:35 user nova-compute[70659]:       <mtu size='1442'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='net0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </interface>
Jul 25 16:48:35 user nova-compute[70659]:     <interface type='ethernet'>
Jul 25 16:48:35 user nova-compute[70659]:       <mac address='fa:16:3e:38:15:25'/>
Jul 25 16:48:35 user nova-compute[70659]:       <target dev='tap4658519b-52'/>
Jul 25 16:48:35 user nova-compute[70659]:       <model type='virtio'/>
Jul 25 16:48:35 user nova-compute[70659]:       <mtu size='1442'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='net1'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </interface>
Jul 25 16:48:35 user nova-compute[70659]:     <serial type='pty'>
Jul 25 16:48:35 user nova-compute[70659]:       <source path='/dev/pts/7'/>
Jul 25 16:48:35 user nova-compute[70659]:       <log file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log' append='off'/>
Jul 25 16:48:35 user nova-compute[70659]:       <target type='isa-serial' port='0'>
Jul 25 16:48:35 user nova-compute[70659]:         <model name='isa-serial'/>
Jul 25 16:48:35 user nova-compute[70659]:       </target>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='serial0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </serial>
Jul 25 16:48:35 user nova-compute[70659]:     <console type='pty' tty='/dev/pts/7'>
Jul 25 16:48:35 user nova-compute[70659]:       <source path='/dev/pts/7'/>
Jul 25 16:48:35 user nova-compute[70659]:       <log file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log' append='off'/>
Jul 25 16:48:35 user nova-compute[70659]:       <target type='serial' port='0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='serial0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </console>
Jul 25 16:48:35 user nova-compute[70659]:     <input type='mouse' bus='ps2'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='input0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </input>
Jul 25 16:48:35 user nova-compute[70659]:     <input type='keyboard' bus='ps2'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='input1'/>
Jul 25 16:48:35 user nova-compute[70659]:     </input>
Jul 25 16:48:35 user nova-compute[70659]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 25 16:48:35 user nova-compute[70659]:       <listen type='address' address='0.0.0.0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </graphics>
Jul 25 16:48:35 user nova-compute[70659]:     <audio id='1' type='none'/>
Jul 25 16:48:35 user nova-compute[70659]:     <video>
Jul 25 16:48:35 user nova-compute[70659]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='video0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </video>
Jul 25 16:48:35 user nova-compute[70659]:     <memballoon model='virtio'>
Jul 25 16:48:35 user nova-compute[70659]:       <stats period='10'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='balloon0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </memballoon>
Jul 25 16:48:35 user nova-compute[70659]:     <rng model='virtio'>
Jul 25 16:48:35 user nova-compute[70659]:       <backend model='random'>/dev/urandom</backend>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='rng0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </rng>
Jul 25 16:48:35 user nova-compute[70659]:   </devices>
Jul 25 16:48:35 user nova-compute[70659]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 16:48:35 user nova-compute[70659]:     <label>libvirt-d437efde-81a8-4be0-b9f8-7a34ee7fea3b</label>
Jul 25 16:48:35 user nova-compute[70659]:     <imagelabel>libvirt-d437efde-81a8-4be0-b9f8-7a34ee7fea3b</imagelabel>
Jul 25 16:48:35 user nova-compute[70659]:   </seclabel>
Jul 25 16:48:35 user nova-compute[70659]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 16:48:35 user nova-compute[70659]:     <label>+64055:+108</label>
Jul 25 16:48:35 user nova-compute[70659]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 16:48:35 user nova-compute[70659]:   </seclabel>
Jul 25 16:48:35 user nova-compute[70659]: </domain>
Jul 25 16:48:35 user nova-compute[70659]:  {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 16:48:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Successfully detached device tap4658519b-52 from instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b from the persistent domain config.
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] (1/8): Attempting to detach device tap4658519b-52 with device alias net1 from instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] detach device xml: <interface type="ethernet">
Jul 25 16:48:35 user nova-compute[70659]:   <mac address="fa:16:3e:38:15:25"/>
Jul 25 16:48:35 user nova-compute[70659]:   <model type="virtio"/>
Jul 25 16:48:35 user nova-compute[70659]:   <mtu size="1442"/>
Jul 25 16:48:35 user nova-compute[70659]:   <target dev="tap4658519b-52"/>
Jul 25 16:48:35 user nova-compute[70659]: </interface>
Jul 25 16:48:35 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690303715.8238602, d437efde-81a8-4be0-b9f8-7a34ee7fea3b => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Start waiting for the detach event from libvirt for device tap4658519b-52 with device alias net1 for instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface> {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 25 16:48:35 user nova-compute[70659]:   <name>instance-00000008</name>
Jul 25 16:48:35 user nova-compute[70659]:   <uuid>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</uuid>
Jul 25 16:48:35 user nova-compute[70659]:   <metadata>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:48:35 user nova-compute[70659]:   <nova:package version="0.0.0"/>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:name>tempest-device-tagging-server-1506231380</nova:name>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:creationTime>2023-07-25 16:48:17</nova:creationTime>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:flavor name="m1.tiny">
Jul 25 16:48:35 user nova-compute[70659]:     <nova:memory>512</nova:memory>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:disk>1</nova:disk>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:swap>0</nova:swap>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:vcpus>1</nova:vcpus>
Jul 25 16:48:35 user nova-compute[70659]:   </nova:flavor>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:owner>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:user uuid="c3c840bf6c1a438bb2e28e2582e6d7fa">tempest-TaggedAttachmentsTest-1788409359-project-member</nova:user>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:project uuid="0c6ebfc7cdb0435287b8e82062151463">tempest-TaggedAttachmentsTest-1788409359</nova:project>
Jul 25 16:48:35 user nova-compute[70659]:   </nova:owner>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:ports>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:port uuid="22b9f6ed-8f52-4a52-84e9-098f874d5682">
Jul 25 16:48:35 user nova-compute[70659]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:48:35 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:port uuid="4658519b-52aa-4ccb-876e-b834ab7d41b5">
Jul 25 16:48:35 user nova-compute[70659]:       <nova:ip type="fixed" address="10.10.10.104" ipVersion="4"/>
Jul 25 16:48:35 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:35 user nova-compute[70659]:   </nova:ports>
Jul 25 16:48:35 user nova-compute[70659]: </nova:instance>
Jul 25 16:48:35 user nova-compute[70659]:   </metadata>
Jul 25 16:48:35 user nova-compute[70659]:   <memory unit='KiB'>524288</memory>
Jul 25 16:48:35 user nova-compute[70659]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 16:48:35 user nova-compute[70659]:   <vcpu placement='static'>1</vcpu>
Jul 25 16:48:35 user nova-compute[70659]:   <resource>
Jul 25 16:48:35 user nova-compute[70659]:     <partition>/machine</partition>
Jul 25 16:48:35 user nova-compute[70659]:   </resource>
Jul 25 16:48:35 user nova-compute[70659]:   <sysinfo type='smbios'>
Jul 25 16:48:35 user nova-compute[70659]:     <system>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='version'>0.0.0</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='serial'>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='uuid'>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:48:35 user nova-compute[70659]:       <entry name='family'>Virtual Machine</entry>
Jul 25 16:48:35 user nova-compute[70659]:     </system>
Jul 25 16:48:35 user nova-compute[70659]:   </sysinfo>
Jul 25 16:48:35 user nova-compute[70659]:   <os>
Jul 25 16:48:35 user nova-compute[70659]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 16:48:35 user nova-compute[70659]:     <boot dev='hd'/>
Jul 25 16:48:35 user nova-compute[70659]:     <smbios mode='sysinfo'/>
Jul 25 16:48:35 user nova-compute[70659]:   </os>
Jul 25 16:48:35 user nova-compute[70659]:   <features>
Jul 25 16:48:35 user nova-compute[70659]:     <acpi/>
Jul 25 16:48:35 user nova-compute[70659]:     <apic/>
Jul 25 16:48:35 user nova-compute[70659]:     <vmcoreinfo state='on'/>
Jul 25 16:48:35 user nova-compute[70659]:   </features>
Jul 25 16:48:35 user nova-compute[70659]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 16:48:35 user nova-compute[70659]:     <model fallback='forbid'>Nehalem</model>
Jul 25 16:48:35 user nova-compute[70659]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 16:48:35 user nova-compute[70659]:     <feature policy='require' name='vme'/>
Jul 25 16:48:35 user nova-compute[70659]:     <feature policy='require' name='x2apic'/>
Jul 25 16:48:35 user nova-compute[70659]:     <feature policy='require' name='hypervisor'/>
Jul 25 16:48:35 user nova-compute[70659]:   </cpu>
Jul 25 16:48:35 user nova-compute[70659]:   <clock offset='utc'>
Jul 25 16:48:35 user nova-compute[70659]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 16:48:35 user nova-compute[70659]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 16:48:35 user nova-compute[70659]:     <timer name='hpet' present='no'/>
Jul 25 16:48:35 user nova-compute[70659]:   </clock>
Jul 25 16:48:35 user nova-compute[70659]:   <on_poweroff>destroy</on_poweroff>
Jul 25 16:48:35 user nova-compute[70659]:   <on_reboot>restart</on_reboot>
Jul 25 16:48:35 user nova-compute[70659]:   <on_crash>destroy</on_crash>
Jul 25 16:48:35 user nova-compute[70659]:   <devices>
Jul 25 16:48:35 user nova-compute[70659]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 16:48:35 user nova-compute[70659]:     <disk type='file' device='disk'>
Jul 25 16:48:35 user nova-compute[70659]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 16:48:35 user nova-compute[70659]:       <source file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk' index='2'/>
Jul 25 16:48:35 user nova-compute[70659]:       <backingStore type='file' index='3'>
Jul 25 16:48:35 user nova-compute[70659]:         <format type='raw'/>
Jul 25 16:48:35 user nova-compute[70659]:         <source file='/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261'/>
Jul 25 16:48:35 user nova-compute[70659]:         <backingStore/>
Jul 25 16:48:35 user nova-compute[70659]:       </backingStore>
Jul 25 16:48:35 user nova-compute[70659]:       <target dev='vda' bus='virtio'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='virtio-disk0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </disk>
Jul 25 16:48:35 user nova-compute[70659]:     <disk type='file' device='cdrom'>
Jul 25 16:48:35 user nova-compute[70659]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 16:48:35 user nova-compute[70659]:       <source file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.config' index='1'/>
Jul 25 16:48:35 user nova-compute[70659]:       <backingStore/>
Jul 25 16:48:35 user nova-compute[70659]:       <target dev='hda' bus='ide'/>
Jul 25 16:48:35 user nova-compute[70659]:       <readonly/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='ide0-0-0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </disk>
Jul 25 16:48:35 user nova-compute[70659]:     <controller type='usb' index='0' model='none'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='usb'/>
Jul 25 16:48:35 user nova-compute[70659]:     </controller>
Jul 25 16:48:35 user nova-compute[70659]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='pci.0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </controller>
Jul 25 16:48:35 user nova-compute[70659]:     <controller type='ide' index='0'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='ide'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 16:48:35 user nova-compute[70659]:     </controller>
Jul 25 16:48:35 user nova-compute[70659]:     <interface type='ethernet'>
Jul 25 16:48:35 user nova-compute[70659]:       <mac address='fa:16:3e:75:35:58'/>
Jul 25 16:48:35 user nova-compute[70659]:       <target dev='tap22b9f6ed-8f'/>
Jul 25 16:48:35 user nova-compute[70659]:       <model type='virtio'/>
Jul 25 16:48:35 user nova-compute[70659]:       <mtu size='1442'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='net0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </interface>
Jul 25 16:48:35 user nova-compute[70659]:     <serial type='pty'>
Jul 25 16:48:35 user nova-compute[70659]:       <source path='/dev/pts/7'/>
Jul 25 16:48:35 user nova-compute[70659]:       <log file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log' append='off'/>
Jul 25 16:48:35 user nova-compute[70659]:       <target type='isa-serial' port='0'>
Jul 25 16:48:35 user nova-compute[70659]:         <model name='isa-serial'/>
Jul 25 16:48:35 user nova-compute[70659]:       </target>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='serial0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </serial>
Jul 25 16:48:35 user nova-compute[70659]:     <console type='pty' tty='/dev/pts/7'>
Jul 25 16:48:35 user nova-compute[70659]:       <source path='/dev/pts/7'/>
Jul 25 16:48:35 user nova-compute[70659]:       <log file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log' append='off'/>
Jul 25 16:48:35 user nova-compute[70659]:       <target type='serial' port='0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='serial0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </console>
Jul 25 16:48:35 user nova-compute[70659]:     <input type='mouse' bus='ps2'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='input0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </input>
Jul 25 16:48:35 user nova-compute[70659]:     <input type='keyboard' bus='ps2'>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='input1'/>
Jul 25 16:48:35 user nova-compute[70659]:     </input>
Jul 25 16:48:35 user nova-compute[70659]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 25 16:48:35 user nova-compute[70659]:       <listen type='address' address='0.0.0.0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </graphics>
Jul 25 16:48:35 user nova-compute[70659]:     <audio id='1' type='none'/>
Jul 25 16:48:35 user nova-compute[70659]:     <video>
Jul 25 16:48:35 user nova-compute[70659]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='video0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </video>
Jul 25 16:48:35 user nova-compute[70659]:     <memballoon model='virtio'>
Jul 25 16:48:35 user nova-compute[70659]:       <stats period='10'/>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='balloon0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </memballoon>
Jul 25 16:48:35 user nova-compute[70659]:     <rng model='virtio'>
Jul 25 16:48:35 user nova-compute[70659]:       <backend model='random'>/dev/urandom</backend>
Jul 25 16:48:35 user nova-compute[70659]:       <alias name='rng0'/>
Jul 25 16:48:35 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 16:48:35 user nova-compute[70659]:     </rng>
Jul 25 16:48:35 user nova-compute[70659]:   </devices>
Jul 25 16:48:35 user nova-compute[70659]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 16:48:35 user nova-compute[70659]:     <label>libvirt-d437efde-81a8-4be0-b9f8-7a34ee7fea3b</label>
Jul 25 16:48:35 user nova-compute[70659]:     <imagelabel>libvirt-d437efde-81a8-4be0-b9f8-7a34ee7fea3b</imagelabel>
Jul 25 16:48:35 user nova-compute[70659]:   </seclabel>
Jul 25 16:48:35 user nova-compute[70659]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 16:48:35 user nova-compute[70659]:     <label>+64055:+108</label>
Jul 25 16:48:35 user nova-compute[70659]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 16:48:35 user nova-compute[70659]:   </seclabel>
Jul 25 16:48:35 user nova-compute[70659]: </domain>
Jul 25 16:48:35 user nova-compute[70659]:  {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 16:48:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Successfully detached device tap4658519b-52 from instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b from the live domain config.
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1506231380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1506231380',id=8,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASmEG7RFCQFi+1G28n7yNAKzcoCuwcnKcQdXmSbHnxoTEkTop7z5XfU9a4Z/QnRF+riya1mdEECpaqnVJkE7ons8sjRqycUy7lP2+85LLnF913u1TMT3K9a21H+JzyCuw==',key_name='tempest-keypair-1108947464',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c6ebfc7cdb0435287b8e82062151463',ramdisk_id='',reservation_id='r-natyacfd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1788409359',owner_user_name='tempest-TaggedAttachmentsTest-1788409359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c840bf6c1a438bb2e28e2582e6d7fa',uuid=d437efde-81a8-4be0-b9f8-7a34ee7fea3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converting VIF {"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG os_vif [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4658519b-52, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:35 user nova-compute[70659]: INFO os_vif [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52')
Jul 25 16:48:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:48:35 user nova-compute[70659]:   <nova:package version="0.0.0"/>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:name>tempest-device-tagging-server-1506231380</nova:name>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:creationTime>2023-07-25 16:48:35</nova:creationTime>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:flavor name="m1.tiny">
Jul 25 16:48:35 user nova-compute[70659]:     <nova:memory>512</nova:memory>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:disk>1</nova:disk>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:swap>0</nova:swap>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:vcpus>1</nova:vcpus>
Jul 25 16:48:35 user nova-compute[70659]:   </nova:flavor>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:owner>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:user uuid="c3c840bf6c1a438bb2e28e2582e6d7fa">tempest-TaggedAttachmentsTest-1788409359-project-member</nova:user>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:project uuid="0c6ebfc7cdb0435287b8e82062151463">tempest-TaggedAttachmentsTest-1788409359</nova:project>
Jul 25 16:48:35 user nova-compute[70659]:   </nova:owner>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:48:35 user nova-compute[70659]:   <nova:ports>
Jul 25 16:48:35 user nova-compute[70659]:     <nova:port uuid="22b9f6ed-8f52-4a52-84e9-098f874d5682">
Jul 25 16:48:35 user nova-compute[70659]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:48:35 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:35 user nova-compute[70659]:   </nova:ports>
Jul 25 16:48:35 user nova-compute[70659]: </nova:instance>
Jul 25 16:48:35 user nova-compute[70659]:  {{(pid=70659) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-a497ecb5-0fdd-4056-9c4b-e33a0a7b9b25 req-3a4a20ec-a01b-4cdd-afb1-c38ed09a1174 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-unplugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a497ecb5-0fdd-4056-9c4b-e33a0a7b9b25 req-3a4a20ec-a01b-4cdd-afb1-c38ed09a1174 service nova] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a497ecb5-0fdd-4056-9c4b-e33a0a7b9b25 req-3a4a20ec-a01b-4cdd-afb1-c38ed09a1174 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a497ecb5-0fdd-4056-9c4b-e33a0a7b9b25 req-3a4a20ec-a01b-4cdd-afb1-c38ed09a1174 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-a497ecb5-0fdd-4056-9c4b-e33a0a7b9b25 req-3a4a20ec-a01b-4cdd-afb1-c38ed09a1174 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] No waiting events found dispatching network-vif-unplugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:36 user nova-compute[70659]: WARNING nova.compute.manager [req-a497ecb5-0fdd-4056-9c4b-e33a0a7b9b25 req-3a4a20ec-a01b-4cdd-afb1-c38ed09a1174 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received unexpected event network-vif-unplugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 for instance with vm_state active and task_state None.
Jul 25 16:48:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquired lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-deleted-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:36 user nova-compute[70659]: INFO nova.compute.manager [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Neutron deleted interface 4658519b-52aa-4ccb-876e-b834ab7d41b5; detaching it from the instance and deleting it from the info cache
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.network.neutron [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updating instance_info_cache with network_info: [{"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.objects.instance [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] Lazy-loading 'system_metadata' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.objects.instance [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] Lazy-loading 'flavor' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1506231380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1506231380',id=8,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASmEG7RFCQFi+1G28n7yNAKzcoCuwcnKcQdXmSbHnxoTEkTop7z5XfU9a4Z/QnRF+riya1mdEECpaqnVJkE7ons8sjRqycUy7lP2+85LLnF913u1TMT3K9a21H+JzyCuw==',key_name='tempest-keypair-1108947464',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c6ebfc7cdb0435287b8e82062151463',ramdisk_id='',reservation_id='r-natyacfd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1788409359',owner_user_name='tempest-TaggedAttachmentsTest-1788409359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c840bf6c1a438bb2e28e2582e6d7fa',uuid=d437efde-81a8-4be0-b9f8-7a34ee7fea3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.network.os_vif_util [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] Converting VIF {"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.network.os_vif_util [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface> {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 25 16:48:36 user nova-compute[70659]:   <name>instance-00000008</name>
Jul 25 16:48:36 user nova-compute[70659]:   <uuid>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</uuid>
Jul 25 16:48:36 user nova-compute[70659]:   <metadata>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:48:36 user nova-compute[70659]:   <nova:package version="0.0.0"/>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:name>tempest-device-tagging-server-1506231380</nova:name>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:creationTime>2023-07-25 16:48:35</nova:creationTime>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:flavor name="m1.tiny">
Jul 25 16:48:36 user nova-compute[70659]:     <nova:memory>512</nova:memory>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:disk>1</nova:disk>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:swap>0</nova:swap>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:vcpus>1</nova:vcpus>
Jul 25 16:48:36 user nova-compute[70659]:   </nova:flavor>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:owner>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:user uuid="c3c840bf6c1a438bb2e28e2582e6d7fa">tempest-TaggedAttachmentsTest-1788409359-project-member</nova:user>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:project uuid="0c6ebfc7cdb0435287b8e82062151463">tempest-TaggedAttachmentsTest-1788409359</nova:project>
Jul 25 16:48:36 user nova-compute[70659]:   </nova:owner>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:ports>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:port uuid="22b9f6ed-8f52-4a52-84e9-098f874d5682">
Jul 25 16:48:36 user nova-compute[70659]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:48:36 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:36 user nova-compute[70659]:   </nova:ports>
Jul 25 16:48:36 user nova-compute[70659]: </nova:instance>
Jul 25 16:48:36 user nova-compute[70659]:   </metadata>
Jul 25 16:48:36 user nova-compute[70659]:   <memory unit='KiB'>524288</memory>
Jul 25 16:48:36 user nova-compute[70659]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 16:48:36 user nova-compute[70659]:   <vcpu placement='static'>1</vcpu>
Jul 25 16:48:36 user nova-compute[70659]:   <resource>
Jul 25 16:48:36 user nova-compute[70659]:     <partition>/machine</partition>
Jul 25 16:48:36 user nova-compute[70659]:   </resource>
Jul 25 16:48:36 user nova-compute[70659]:   <sysinfo type='smbios'>
Jul 25 16:48:36 user nova-compute[70659]:     <system>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='version'>0.0.0</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='serial'>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='uuid'>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='family'>Virtual Machine</entry>
Jul 25 16:48:36 user nova-compute[70659]:     </system>
Jul 25 16:48:36 user nova-compute[70659]:   </sysinfo>
Jul 25 16:48:36 user nova-compute[70659]:   <os>
Jul 25 16:48:36 user nova-compute[70659]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 16:48:36 user nova-compute[70659]:     <boot dev='hd'/>
Jul 25 16:48:36 user nova-compute[70659]:     <smbios mode='sysinfo'/>
Jul 25 16:48:36 user nova-compute[70659]:   </os>
Jul 25 16:48:36 user nova-compute[70659]:   <features>
Jul 25 16:48:36 user nova-compute[70659]:     <acpi/>
Jul 25 16:48:36 user nova-compute[70659]:     <apic/>
Jul 25 16:48:36 user nova-compute[70659]:     <vmcoreinfo state='on'/>
Jul 25 16:48:36 user nova-compute[70659]:   </features>
Jul 25 16:48:36 user nova-compute[70659]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 16:48:36 user nova-compute[70659]:     <model fallback='forbid'>Nehalem</model>
Jul 25 16:48:36 user nova-compute[70659]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 16:48:36 user nova-compute[70659]:     <feature policy='require' name='vme'/>
Jul 25 16:48:36 user nova-compute[70659]:     <feature policy='require' name='x2apic'/>
Jul 25 16:48:36 user nova-compute[70659]:     <feature policy='require' name='hypervisor'/>
Jul 25 16:48:36 user nova-compute[70659]:   </cpu>
Jul 25 16:48:36 user nova-compute[70659]:   <clock offset='utc'>
Jul 25 16:48:36 user nova-compute[70659]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 16:48:36 user nova-compute[70659]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 16:48:36 user nova-compute[70659]:     <timer name='hpet' present='no'/>
Jul 25 16:48:36 user nova-compute[70659]:   </clock>
Jul 25 16:48:36 user nova-compute[70659]:   <on_poweroff>destroy</on_poweroff>
Jul 25 16:48:36 user nova-compute[70659]:   <on_reboot>restart</on_reboot>
Jul 25 16:48:36 user nova-compute[70659]:   <on_crash>destroy</on_crash>
Jul 25 16:48:36 user nova-compute[70659]:   <devices>
Jul 25 16:48:36 user nova-compute[70659]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 16:48:36 user nova-compute[70659]:     <disk type='file' device='disk'>
Jul 25 16:48:36 user nova-compute[70659]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 16:48:36 user nova-compute[70659]:       <source file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk' index='2'/>
Jul 25 16:48:36 user nova-compute[70659]:       <backingStore type='file' index='3'>
Jul 25 16:48:36 user nova-compute[70659]:         <format type='raw'/>
Jul 25 16:48:36 user nova-compute[70659]:         <source file='/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261'/>
Jul 25 16:48:36 user nova-compute[70659]:         <backingStore/>
Jul 25 16:48:36 user nova-compute[70659]:       </backingStore>
Jul 25 16:48:36 user nova-compute[70659]:       <target dev='vda' bus='virtio'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='virtio-disk0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </disk>
Jul 25 16:48:36 user nova-compute[70659]:     <disk type='file' device='cdrom'>
Jul 25 16:48:36 user nova-compute[70659]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 16:48:36 user nova-compute[70659]:       <source file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.config' index='1'/>
Jul 25 16:48:36 user nova-compute[70659]:       <backingStore/>
Jul 25 16:48:36 user nova-compute[70659]:       <target dev='hda' bus='ide'/>
Jul 25 16:48:36 user nova-compute[70659]:       <readonly/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='ide0-0-0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </disk>
Jul 25 16:48:36 user nova-compute[70659]:     <controller type='usb' index='0' model='none'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='usb'/>
Jul 25 16:48:36 user nova-compute[70659]:     </controller>
Jul 25 16:48:36 user nova-compute[70659]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='pci.0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </controller>
Jul 25 16:48:36 user nova-compute[70659]:     <controller type='ide' index='0'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='ide'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 16:48:36 user nova-compute[70659]:     </controller>
Jul 25 16:48:36 user nova-compute[70659]:     <interface type='ethernet'>
Jul 25 16:48:36 user nova-compute[70659]:       <mac address='fa:16:3e:75:35:58'/>
Jul 25 16:48:36 user nova-compute[70659]:       <target dev='tap22b9f6ed-8f'/>
Jul 25 16:48:36 user nova-compute[70659]:       <model type='virtio'/>
Jul 25 16:48:36 user nova-compute[70659]:       <mtu size='1442'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='net0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </interface>
Jul 25 16:48:36 user nova-compute[70659]:     <serial type='pty'>
Jul 25 16:48:36 user nova-compute[70659]:       <source path='/dev/pts/7'/>
Jul 25 16:48:36 user nova-compute[70659]:       <log file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log' append='off'/>
Jul 25 16:48:36 user nova-compute[70659]:       <target type='isa-serial' port='0'>
Jul 25 16:48:36 user nova-compute[70659]:         <model name='isa-serial'/>
Jul 25 16:48:36 user nova-compute[70659]:       </target>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='serial0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </serial>
Jul 25 16:48:36 user nova-compute[70659]:     <console type='pty' tty='/dev/pts/7'>
Jul 25 16:48:36 user nova-compute[70659]:       <source path='/dev/pts/7'/>
Jul 25 16:48:36 user nova-compute[70659]:       <log file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log' append='off'/>
Jul 25 16:48:36 user nova-compute[70659]:       <target type='serial' port='0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='serial0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </console>
Jul 25 16:48:36 user nova-compute[70659]:     <input type='mouse' bus='ps2'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='input0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </input>
Jul 25 16:48:36 user nova-compute[70659]:     <input type='keyboard' bus='ps2'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='input1'/>
Jul 25 16:48:36 user nova-compute[70659]:     </input>
Jul 25 16:48:36 user nova-compute[70659]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 25 16:48:36 user nova-compute[70659]:       <listen type='address' address='0.0.0.0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </graphics>
Jul 25 16:48:36 user nova-compute[70659]:     <audio id='1' type='none'/>
Jul 25 16:48:36 user nova-compute[70659]:     <video>
Jul 25 16:48:36 user nova-compute[70659]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='video0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </video>
Jul 25 16:48:36 user nova-compute[70659]:     <memballoon model='virtio'>
Jul 25 16:48:36 user nova-compute[70659]:       <stats period='10'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='balloon0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </memballoon>
Jul 25 16:48:36 user nova-compute[70659]:     <rng model='virtio'>
Jul 25 16:48:36 user nova-compute[70659]:       <backend model='random'>/dev/urandom</backend>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='rng0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </rng>
Jul 25 16:48:36 user nova-compute[70659]:   </devices>
Jul 25 16:48:36 user nova-compute[70659]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 16:48:36 user nova-compute[70659]:     <label>libvirt-d437efde-81a8-4be0-b9f8-7a34ee7fea3b</label>
Jul 25 16:48:36 user nova-compute[70659]:     <imagelabel>libvirt-d437efde-81a8-4be0-b9f8-7a34ee7fea3b</imagelabel>
Jul 25 16:48:36 user nova-compute[70659]:   </seclabel>
Jul 25 16:48:36 user nova-compute[70659]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 16:48:36 user nova-compute[70659]:     <label>+64055:+108</label>
Jul 25 16:48:36 user nova-compute[70659]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 16:48:36 user nova-compute[70659]:   </seclabel>
Jul 25 16:48:36 user nova-compute[70659]: </domain>
Jul 25 16:48:36 user nova-compute[70659]:  {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface> {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:15:25"/><model type="virtio"/><mtu size="1442"/><target dev="tap4658519b-52"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 25 16:48:36 user nova-compute[70659]:   <name>instance-00000008</name>
Jul 25 16:48:36 user nova-compute[70659]:   <uuid>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</uuid>
Jul 25 16:48:36 user nova-compute[70659]:   <metadata>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:48:36 user nova-compute[70659]:   <nova:package version="0.0.0"/>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:name>tempest-device-tagging-server-1506231380</nova:name>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:creationTime>2023-07-25 16:48:35</nova:creationTime>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:flavor name="m1.tiny">
Jul 25 16:48:36 user nova-compute[70659]:     <nova:memory>512</nova:memory>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:disk>1</nova:disk>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:swap>0</nova:swap>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:vcpus>1</nova:vcpus>
Jul 25 16:48:36 user nova-compute[70659]:   </nova:flavor>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:owner>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:user uuid="c3c840bf6c1a438bb2e28e2582e6d7fa">tempest-TaggedAttachmentsTest-1788409359-project-member</nova:user>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:project uuid="0c6ebfc7cdb0435287b8e82062151463">tempest-TaggedAttachmentsTest-1788409359</nova:project>
Jul 25 16:48:36 user nova-compute[70659]:   </nova:owner>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:ports>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:port uuid="22b9f6ed-8f52-4a52-84e9-098f874d5682">
Jul 25 16:48:36 user nova-compute[70659]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:48:36 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:36 user nova-compute[70659]:   </nova:ports>
Jul 25 16:48:36 user nova-compute[70659]: </nova:instance>
Jul 25 16:48:36 user nova-compute[70659]:   </metadata>
Jul 25 16:48:36 user nova-compute[70659]:   <memory unit='KiB'>524288</memory>
Jul 25 16:48:36 user nova-compute[70659]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 16:48:36 user nova-compute[70659]:   <vcpu placement='static'>1</vcpu>
Jul 25 16:48:36 user nova-compute[70659]:   <resource>
Jul 25 16:48:36 user nova-compute[70659]:     <partition>/machine</partition>
Jul 25 16:48:36 user nova-compute[70659]:   </resource>
Jul 25 16:48:36 user nova-compute[70659]:   <sysinfo type='smbios'>
Jul 25 16:48:36 user nova-compute[70659]:     <system>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='version'>0.0.0</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='serial'>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='uuid'>d437efde-81a8-4be0-b9f8-7a34ee7fea3b</entry>
Jul 25 16:48:36 user nova-compute[70659]:       <entry name='family'>Virtual Machine</entry>
Jul 25 16:48:36 user nova-compute[70659]:     </system>
Jul 25 16:48:36 user nova-compute[70659]:   </sysinfo>
Jul 25 16:48:36 user nova-compute[70659]:   <os>
Jul 25 16:48:36 user nova-compute[70659]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 16:48:36 user nova-compute[70659]:     <boot dev='hd'/>
Jul 25 16:48:36 user nova-compute[70659]:     <smbios mode='sysinfo'/>
Jul 25 16:48:36 user nova-compute[70659]:   </os>
Jul 25 16:48:36 user nova-compute[70659]:   <features>
Jul 25 16:48:36 user nova-compute[70659]:     <acpi/>
Jul 25 16:48:36 user nova-compute[70659]:     <apic/>
Jul 25 16:48:36 user nova-compute[70659]:     <vmcoreinfo state='on'/>
Jul 25 16:48:36 user nova-compute[70659]:   </features>
Jul 25 16:48:36 user nova-compute[70659]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 16:48:36 user nova-compute[70659]:     <model fallback='forbid'>Nehalem</model>
Jul 25 16:48:36 user nova-compute[70659]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 16:48:36 user nova-compute[70659]:     <feature policy='require' name='vme'/>
Jul 25 16:48:36 user nova-compute[70659]:     <feature policy='require' name='x2apic'/>
Jul 25 16:48:36 user nova-compute[70659]:     <feature policy='require' name='hypervisor'/>
Jul 25 16:48:36 user nova-compute[70659]:   </cpu>
Jul 25 16:48:36 user nova-compute[70659]:   <clock offset='utc'>
Jul 25 16:48:36 user nova-compute[70659]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 16:48:36 user nova-compute[70659]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 16:48:36 user nova-compute[70659]:     <timer name='hpet' present='no'/>
Jul 25 16:48:36 user nova-compute[70659]:   </clock>
Jul 25 16:48:36 user nova-compute[70659]:   <on_poweroff>destroy</on_poweroff>
Jul 25 16:48:36 user nova-compute[70659]:   <on_reboot>restart</on_reboot>
Jul 25 16:48:36 user nova-compute[70659]:   <on_crash>destroy</on_crash>
Jul 25 16:48:36 user nova-compute[70659]:   <devices>
Jul 25 16:48:36 user nova-compute[70659]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 16:48:36 user nova-compute[70659]:     <disk type='file' device='disk'>
Jul 25 16:48:36 user nova-compute[70659]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 16:48:36 user nova-compute[70659]:       <source file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk' index='2'/>
Jul 25 16:48:36 user nova-compute[70659]:       <backingStore type='file' index='3'>
Jul 25 16:48:36 user nova-compute[70659]:         <format type='raw'/>
Jul 25 16:48:36 user nova-compute[70659]:         <source file='/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261'/>
Jul 25 16:48:36 user nova-compute[70659]:         <backingStore/>
Jul 25 16:48:36 user nova-compute[70659]:       </backingStore>
Jul 25 16:48:36 user nova-compute[70659]:       <target dev='vda' bus='virtio'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='virtio-disk0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </disk>
Jul 25 16:48:36 user nova-compute[70659]:     <disk type='file' device='cdrom'>
Jul 25 16:48:36 user nova-compute[70659]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 16:48:36 user nova-compute[70659]:       <source file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk.config' index='1'/>
Jul 25 16:48:36 user nova-compute[70659]:       <backingStore/>
Jul 25 16:48:36 user nova-compute[70659]:       <target dev='hda' bus='ide'/>
Jul 25 16:48:36 user nova-compute[70659]:       <readonly/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='ide0-0-0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </disk>
Jul 25 16:48:36 user nova-compute[70659]:     <controller type='usb' index='0' model='none'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='usb'/>
Jul 25 16:48:36 user nova-compute[70659]:     </controller>
Jul 25 16:48:36 user nova-compute[70659]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='pci.0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </controller>
Jul 25 16:48:36 user nova-compute[70659]:     <controller type='ide' index='0'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='ide'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 16:48:36 user nova-compute[70659]:     </controller>
Jul 25 16:48:36 user nova-compute[70659]:     <interface type='ethernet'>
Jul 25 16:48:36 user nova-compute[70659]:       <mac address='fa:16:3e:75:35:58'/>
Jul 25 16:48:36 user nova-compute[70659]:       <target dev='tap22b9f6ed-8f'/>
Jul 25 16:48:36 user nova-compute[70659]:       <model type='virtio'/>
Jul 25 16:48:36 user nova-compute[70659]:       <mtu size='1442'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='net0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </interface>
Jul 25 16:48:36 user nova-compute[70659]:     <serial type='pty'>
Jul 25 16:48:36 user nova-compute[70659]:       <source path='/dev/pts/7'/>
Jul 25 16:48:36 user nova-compute[70659]:       <log file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log' append='off'/>
Jul 25 16:48:36 user nova-compute[70659]:       <target type='isa-serial' port='0'>
Jul 25 16:48:36 user nova-compute[70659]:         <model name='isa-serial'/>
Jul 25 16:48:36 user nova-compute[70659]:       </target>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='serial0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </serial>
Jul 25 16:48:36 user nova-compute[70659]:     <console type='pty' tty='/dev/pts/7'>
Jul 25 16:48:36 user nova-compute[70659]:       <source path='/dev/pts/7'/>
Jul 25 16:48:36 user nova-compute[70659]:       <log file='/opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/console.log' append='off'/>
Jul 25 16:48:36 user nova-compute[70659]:       <target type='serial' port='0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='serial0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </console>
Jul 25 16:48:36 user nova-compute[70659]:     <input type='mouse' bus='ps2'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='input0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </input>
Jul 25 16:48:36 user nova-compute[70659]:     <input type='keyboard' bus='ps2'>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='input1'/>
Jul 25 16:48:36 user nova-compute[70659]:     </input>
Jul 25 16:48:36 user nova-compute[70659]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 25 16:48:36 user nova-compute[70659]:       <listen type='address' address='0.0.0.0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </graphics>
Jul 25 16:48:36 user nova-compute[70659]:     <audio id='1' type='none'/>
Jul 25 16:48:36 user nova-compute[70659]:     <video>
Jul 25 16:48:36 user nova-compute[70659]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='video0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </video>
Jul 25 16:48:36 user nova-compute[70659]:     <memballoon model='virtio'>
Jul 25 16:48:36 user nova-compute[70659]:       <stats period='10'/>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='balloon0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </memballoon>
Jul 25 16:48:36 user nova-compute[70659]:     <rng model='virtio'>
Jul 25 16:48:36 user nova-compute[70659]:       <backend model='random'>/dev/urandom</backend>
Jul 25 16:48:36 user nova-compute[70659]:       <alias name='rng0'/>
Jul 25 16:48:36 user nova-compute[70659]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 16:48:36 user nova-compute[70659]:     </rng>
Jul 25 16:48:36 user nova-compute[70659]:   </devices>
Jul 25 16:48:36 user nova-compute[70659]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 16:48:36 user nova-compute[70659]:     <label>libvirt-d437efde-81a8-4be0-b9f8-7a34ee7fea3b</label>
Jul 25 16:48:36 user nova-compute[70659]:     <imagelabel>libvirt-d437efde-81a8-4be0-b9f8-7a34ee7fea3b</imagelabel>
Jul 25 16:48:36 user nova-compute[70659]:   </seclabel>
Jul 25 16:48:36 user nova-compute[70659]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 16:48:36 user nova-compute[70659]:     <label>+64055:+108</label>
Jul 25 16:48:36 user nova-compute[70659]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 16:48:36 user nova-compute[70659]:   </seclabel>
Jul 25 16:48:36 user nova-compute[70659]: </domain>
Jul 25 16:48:36 user nova-compute[70659]:  {{(pid=70659) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 16:48:36 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Detaching interface fa:16:3e:38:15:25 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap4658519b-52' not found.
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1506231380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1506231380',id=8,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASmEG7RFCQFi+1G28n7yNAKzcoCuwcnKcQdXmSbHnxoTEkTop7z5XfU9a4Z/QnRF+riya1mdEECpaqnVJkE7ons8sjRqycUy7lP2+85LLnF913u1TMT3K9a21H+JzyCuw==',key_name='tempest-keypair-1108947464',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c6ebfc7cdb0435287b8e82062151463',ramdisk_id='',reservation_id='r-natyacfd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1788409359',owner_user_name='tempest-TaggedAttachmentsTest-1788409359-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c840bf6c1a438bb2e28e2582e6d7fa',uuid=d437efde-81a8-4be0-b9f8-7a34ee7fea3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.network.os_vif_util [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] Converting VIF {"id": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "address": "fa:16:3e:38:15:25", "network": {"id": "8a241eff-339c-4afa-ac02-10fd7edacaa4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-501131916", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4658519b-52", "ovs_interfaceid": "4658519b-52aa-4ccb-876e-b834ab7d41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.network.os_vif_util [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG os_vif [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4658519b-52, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:48:36 user nova-compute[70659]: INFO os_vif [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:15:25,bridge_name='br-int',has_traffic_filtering=True,id=4658519b-52aa-4ccb-876e-b834ab7d41b5,network=Network(8a241eff-339c-4afa-ac02-10fd7edacaa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4658519b-52')
Jul 25 16:48:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [req-662a4015-e471-4cbf-91c9-3d49c04055f2 req-62adf111-c57d-48a6-b10d-0dbcec353b4b service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:48:36 user nova-compute[70659]:   <nova:package version="0.0.0"/>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:name>tempest-device-tagging-server-1506231380</nova:name>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:creationTime>2023-07-25 16:48:36</nova:creationTime>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:flavor name="m1.tiny">
Jul 25 16:48:36 user nova-compute[70659]:     <nova:memory>512</nova:memory>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:disk>1</nova:disk>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:swap>0</nova:swap>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:vcpus>1</nova:vcpus>
Jul 25 16:48:36 user nova-compute[70659]:   </nova:flavor>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:owner>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:user uuid="c3c840bf6c1a438bb2e28e2582e6d7fa">tempest-TaggedAttachmentsTest-1788409359-project-member</nova:user>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:project uuid="0c6ebfc7cdb0435287b8e82062151463">tempest-TaggedAttachmentsTest-1788409359</nova:project>
Jul 25 16:48:36 user nova-compute[70659]:   </nova:owner>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:48:36 user nova-compute[70659]:   <nova:ports>
Jul 25 16:48:36 user nova-compute[70659]:     <nova:port uuid="22b9f6ed-8f52-4a52-84e9-098f874d5682">
Jul 25 16:48:36 user nova-compute[70659]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:48:36 user nova-compute[70659]:     </nova:port>
Jul 25 16:48:36 user nova-compute[70659]:   </nova:ports>
Jul 25 16:48:36 user nova-compute[70659]: </nova:instance>
Jul 25 16:48:36 user nova-compute[70659]:  {{(pid=70659) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 25 16:48:37 user nova-compute[70659]: INFO nova.network.neutron [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Port 4658519b-52aa-4ccb-876e-b834ab7d41b5 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 25 16:48:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updating instance_info_cache with network_info: [{"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Releasing lock "refresh_cache-d437efde-81a8-4be0-b9f8-7a34ee7fea3b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-586164a4-7667-4c63-ad41-903c7303017a tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "interface-d437efde-81a8-4be0-b9f8-7a34ee7fea3b-4658519b-52aa-4ccb-876e-b834ab7d41b5" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.880s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-7de1c607-6455-47e9-9d94-b635a0d304fc req-0a7a32c7-4459-4cfb-85c0-54f8f0990f81 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-plugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7de1c607-6455-47e9-9d94-b635a0d304fc req-0a7a32c7-4459-4cfb-85c0-54f8f0990f81 service nova] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7de1c607-6455-47e9-9d94-b635a0d304fc req-0a7a32c7-4459-4cfb-85c0-54f8f0990f81 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7de1c607-6455-47e9-9d94-b635a0d304fc req-0a7a32c7-4459-4cfb-85c0-54f8f0990f81 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-7de1c607-6455-47e9-9d94-b635a0d304fc req-0a7a32c7-4459-4cfb-85c0-54f8f0990f81 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] No waiting events found dispatching network-vif-plugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:38 user nova-compute[70659]: WARNING nova.compute.manager [req-7de1c607-6455-47e9-9d94-b635a0d304fc req-0a7a32c7-4459-4cfb-85c0-54f8f0990f81 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received unexpected event network-vif-plugged-4658519b-52aa-4ccb-876e-b834ab7d41b5 for instance with vm_state active and task_state None.
Jul 25 16:48:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTUEFiGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:40 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:40 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:40 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf24abc-1c6c-456f-b9db-922081012095]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:48:40 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[803022c1-29aa-4e1e-8a43-05fb6267a935]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29] added
Jul 25 16:48:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbf10e1-f438-4136-a1fb-a43f57c3e9b6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af7edc9-6b7a-4df1-b53a-60f158c0afdc]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTUEFiGp {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTUEFiGp" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6ecd9a-5b51-4d18-8469-6c81b79d20cb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTUEFiGp'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29f21cc-c6a5-450f-80c3-066686695395]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc67709-ef32-4e18-9a36-3206774605b9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1dfd97-0a38-4188-8c46-d8775152eec9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260]
Jul 25 16:48:40 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c43cc2-1a3b-48a9-b1aa-edbdb1bc9d2d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0e75a6-4022-4e48-acbd-3b466e025354]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a69c7b-c89d-4352-80cb-b81ea57ab04d (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:40 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[69369aa8-c24e-4833-8fb3-bf1d35e0ceda]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:48:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTUEFiGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:48:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23162326232383231', 'path': '/dev/sdk'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162326232383231', 'path': '/dev/sdk'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:48:41 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lazy-loading 'flavor' on Instance uuid 98c0757f-7146-48ea-ac36-e7c107e74d73 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:48:41 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:41 user nova-compute[70659]:   <source dev="/dev/sdk"/>
Jul 25 16:48:41 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:48:41 user nova-compute[70659]:   <serial>4631a1ff-4cfe-4c1f-8958-8232a8ca6c29</serial>
Jul 25 16:48:41 user nova-compute[70659]: </disk>
Jul 25 16:48:41 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] No VIF found with MAC fa:16:3e:bd:02:a4, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ce6d9c25-5328-477d-bda6-0116bf4a1e6b tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.789s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG os_brick.utils [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fd0acd-a090-4ff7-a1ca-7404f3db68cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[039e7130-9baf-4809-a7a9-894eec7abde4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a35f6d-7c9d-4cc3-bee7-f085dd117b7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b1bd21-12b6-4555-85eb-c2bbfdb4d037]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:48:43 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc33d47e-3ba5-4bc5-98d0-1e49a32a4158]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG os_brick.utils [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:44 user nova-compute[70659]: INFO nova.compute.manager [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Swapping volume 4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 for 0468db03-65c8-42a3-851f-053f386ab726
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:48:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:48:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGhLCUrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:46 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:46 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:46 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:48:46 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=6811MB free_disk=25.567214965820312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa746395-7ce6-4a8d-8d8c-47a4f0ee683e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:48:46 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede27784-72f8-4bdc-aa6c-d583775643a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b] added
Jul 25 16:48:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b786faf-90bb-4534-9412-29cd02e0f8b5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aab9523-9b5a-407e-8035-e5cb3185201a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGhLCUrD {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGhLCUrD" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[599368c7-8cd1-4856-8102-7e18533451ac]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OGhLCUrD'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f12bcd9-d7ae-4a39-a0be-ae7e608577eb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c9728d00-f454-4616-af0b-8cfd0f012cad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 7d47d257-3a12-48d8-bdb1-adec83869c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 98c0757f-7146-48ea-ac36-e7c107e74d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f576940c-5074-4199-a850-8bf6bf9df4f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 6f6117f9-a000-4491-bd38-b7525298c23a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[256ab9f3-c380-448d-834a-0c58b2fd5dad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f857fd66-be50-42c7-b6b9-5a4548d785eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b, portal: 172.16.0.220,3260]
Jul 25 16:48:46 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9630325e-3189-471e-8fbc-2c24f090fee0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f8b3a3-9f36-4fae-b4ca-e21e37b24825]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:46 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[165b54ba-6d95-423d-bcba-7ab2a3dee792]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:48:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGhLCUrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '26132613937643838', 'path': '/dev/sdj'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132613937643838', 'path': '/dev/sdj'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG nova.objects.instance [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lazy-loading 'flavor' on Instance uuid 7d47d257-3a12-48d8-bdb1-adec83869c41 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:48:47 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:47 user nova-compute[70659]:   <source dev="/dev/sdj"/>
Jul 25 16:48:47 user nova-compute[70659]:   <target dev="sdc" bus="scsi"/>
Jul 25 16:48:47 user nova-compute[70659]:   <serial>658d3963-c40e-4570-8ff3-6c3d03d6c15b</serial>
Jul 25 16:48:47 user nova-compute[70659]:   <address type="drive" controller="0" unit="2"/>
Jul 25 16:48:47 user nova-compute[70659]: </disk>
Jul 25 16:48:47 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:48:47 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] No BDM found with device name sda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] No VIF found with MAC fa:16:3e:57:92:1e, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Updating instance_info_cache with network_info: [{"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:48:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83ee7697-376c-4d25-afaf-78bf876f1f42 tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.617s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:49 user nova-compute[70659]: INFO nova.compute.manager [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Detaching volume 658d3963-c40e-4570-8ff3-6c3d03d6c15b
Jul 25 16:48:49 user nova-compute[70659]: INFO nova.virt.block_device [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Attempting to driver detach volume 658d3963-c40e-4570-8ff3-6c3d03d6c15b from mountpoint /dev/sdc
Jul 25 16:48:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Attempting to detach device sdc from instance 7d47d257-3a12-48d8-bdb1-adec83869c41 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:48:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:48:49 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:49 user nova-compute[70659]:   <source dev="/dev/sdj"/>
Jul 25 16:48:49 user nova-compute[70659]:   <target dev="sdc" bus="scsi"/>
Jul 25 16:48:49 user nova-compute[70659]:   <serial>658d3963-c40e-4570-8ff3-6c3d03d6c15b</serial>
Jul 25 16:48:49 user nova-compute[70659]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 25 16:48:49 user nova-compute[70659]: </disk>
Jul 25 16:48:49 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:48:49 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Successfully detached device sdc from instance 7d47d257-3a12-48d8-bdb1-adec83869c41 from the persistent domain config.
Jul 25 16:48:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 7d47d257-3a12-48d8-bdb1-adec83869c41 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:48:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:48:49 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:48:49 user nova-compute[70659]:   <source dev="/dev/sdj"/>
Jul 25 16:48:49 user nova-compute[70659]:   <target dev="sdc" bus="scsi"/>
Jul 25 16:48:49 user nova-compute[70659]:   <serial>658d3963-c40e-4570-8ff3-6c3d03d6c15b</serial>
Jul 25 16:48:49 user nova-compute[70659]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 25 16:48:49 user nova-compute[70659]: </disk>
Jul 25 16:48:49 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690303730.161393, 7d47d257-3a12-48d8-bdb1-adec83869c41 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 7d47d257-3a12-48d8-bdb1-adec83869c41 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:48:50 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Successfully detached device sdc from instance 7d47d257-3a12-48d8-bdb1-adec83869c41 from the live domain config.
Jul 25 16:48:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGhLCUrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:50 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd79e08-af44-45b8-b635-6a4b7b41d04e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b5002f-a629-4a9a-a0e4-0526e10e3ebc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:50 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e271693-9a5c-4069-8faf-9428c104cb7e (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:50 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:50 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30347880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b'): ({'sdj'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Removing single pathed devices sdj {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b984cc-c534-4ede-a269-e454cafdc3f7]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc92b83-7ad4-496b-9a9d-09eeb1760ca4]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Flushing IO for device /dev/sdj {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[719e5ed1-d90c-48e0-9f52-cc2eb8387c1c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc4b8d6-261e-4c98-bbc9-d045204323b5]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] SCSI volumes sdj have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b73c0d-e94d-41d2-ae73-b11d1caf1d9f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[17624188-a35d-4cd0-9f62-730b98f349ab]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b, portal: 172.16.0.220,3260]
Jul 25 16:48:50 user nova-compute[70659]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:50 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:658d3963-c40e-4570-8ff3-6c3d03d6c15b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a304e489-d566-4406-b2cc-d7b7d129684a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] <== disconnect_volume: return (331ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:51 user nova-compute[70659]: DEBUG nova.objects.instance [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lazy-loading 'flavor' on Instance uuid 7d47d257-3a12-48d8-bdb1-adec83869c41 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-147f7f72-a749-4e0a-b751-3e531a8b12cf tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.597s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:52 user nova-compute[70659]: INFO nova.compute.manager [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Terminating instance
Jul 25 16:48:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-c2fe9cae-8d2f-49b9-bcf2-58ce5da42e79 req-3f301380-7000-44b0-b881-7a8c6513cf7d service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received event network-vif-unplugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c2fe9cae-8d2f-49b9-bcf2-58ce5da42e79 req-3f301380-7000-44b0-b881-7a8c6513cf7d service nova] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c2fe9cae-8d2f-49b9-bcf2-58ce5da42e79 req-3f301380-7000-44b0-b881-7a8c6513cf7d service nova] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c2fe9cae-8d2f-49b9-bcf2-58ce5da42e79 req-3f301380-7000-44b0-b881-7a8c6513cf7d service nova] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-c2fe9cae-8d2f-49b9-bcf2-58ce5da42e79 req-3f301380-7000-44b0-b881-7a8c6513cf7d service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] No waiting events found dispatching network-vif-unplugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-c2fe9cae-8d2f-49b9-bcf2-58ce5da42e79 req-3f301380-7000-44b0-b881-7a8c6513cf7d service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received event network-vif-unplugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:48:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Instance destroyed successfully.
Jul 25 16:48:53 user nova-compute[70659]: DEBUG nova.objects.instance [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lazy-loading 'resources' on Instance uuid 7d47d257-3a12-48d8-bdb1-adec83869c41 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-232816778',display_name='tempest-AttachSCSIVolumeTestJSON-server-232816778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-232816778',id=9,image_ref='123cd06a-9f8f-4ae8-8713-6be1bae433cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoSG4GQbe1LcW30OGqdpCrzqKywM7PlMIzqAylE6JjeJfC10mddixfpctd5ROj9yvfXJFjmpfySWnd56nxNYPvUHo4ZW3hC1n6XnpF6C7mihQ4aLmoNr+MsbtWglRiL/w==',key_name='tempest-keypair-2070017815',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdaea2e7f1fd4577a680fa3bcd9fd889',ramdisk_id='',reservation_id='r-48tjw644',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='123cd06a-9f8f-4ae8-8713-6be1bae433cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-732415869',owner_user_name='tempest-AttachSCSIVolumeTestJSON-732415869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2003d8d874854bc4acb422289d1526a3',uuid=7d47d257-3a12-48d8-bdb1-adec83869c41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Converting VIF {"id": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "address": "fa:16:3e:57:92:1e", "network": {"id": "12745182-c92e-41f1-9e11-5f811fadb16e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1119146694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaea2e7f1fd4577a680fa3bcd9fd889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6b068df-7e", "ovs_interfaceid": "b6b068df-7e92-4f25-b964-6c3492bcd6ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:92:1e,bridge_name='br-int',has_traffic_filtering=True,id=b6b068df-7e92-4f25-b964-6c3492bcd6ec,network=Network(12745182-c92e-41f1-9e11-5f811fadb16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6b068df-7e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG os_vif [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:92:1e,bridge_name='br-int',has_traffic_filtering=True,id=b6b068df-7e92-4f25-b964-6c3492bcd6ec,network=Network(12745182-c92e-41f1-9e11-5f811fadb16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6b068df-7e') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6b068df-7e, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:53 user nova-compute[70659]: INFO os_vif [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:92:1e,bridge_name='br-int',has_traffic_filtering=True,id=b6b068df-7e92-4f25-b964-6c3492bcd6ec,network=Network(12745182-c92e-41f1-9e11-5f811fadb16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6b068df-7e')
Jul 25 16:48:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Deleting instance files /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41_del
Jul 25 16:48:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Deletion of /opt/stack/data/nova/instances/7d47d257-3a12-48d8-bdb1-adec83869c41_del complete
Jul 25 16:48:53 user nova-compute[70659]: INFO nova.compute.manager [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 25 16:48:53 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:48:53 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVYczKGl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98c0757f-7146-48ea-ac36-e7c107e74d73', 'attached_at': '', 'detached_at': '', 'volume_id': '0468db03-65c8-42a3-851f-053f386ab726', 'serial': '0468db03-65c8-42a3-851f-053f386ab726'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTUEFiGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '98c0757f-7146-48ea-ac36-e7c107e74d73', 'attached_at': '', 'detached_at': '', 'volume_id': '4631a1ff-4cfe-4c1f-8958-8232a8ca6c29', 'serial'} {{(pid=70659) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVYczKGl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:54 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:54 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:54 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab17311-5311-4cd0-9d83-369f0c2fecf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:48:54 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfcb8f0-8536-4d71-a1f2-3c89bac9a386]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726] added
Jul 25 16:48:54 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bad5f4-89bc-442c-9ad2-3dcf96936f47]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f3e096-bd5f-483a-87a5-5a85afe2d761]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVYczKGl {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVYczKGl" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c874a-697b-4491-ac5f-bf4519398ee3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WVYczKGl'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3396cc-1ccc-4739-b0f9-49c487c4e6fd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.069s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[190b7229-a5ec-4560-a52a-356a13184e32]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:54 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:54 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[256b4a94-2b42-4d13-8f1c-fb1eaa58f5c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726, portal: 172.16.0.220,3260]
Jul 25 16:48:54 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:54 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04337fd-26c8-4061-b883-548d77f98261]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ca7799-9adb-45f4-b75e-5668113f50d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:54 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:54 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:54 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] HCTL ('41', '-', '-', 0) found on session 16 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f504ebc9-3938-4c4b-8ab2-27c45df47ac3]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Searching for a device in session 16 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVYczKGl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:48:54 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Took 1.42 seconds to deallocate network for instance.
Jul 25 16:48:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-892104ac-00aa-4d33-904f-12943a02e6ab req-e46a7870-b9fd-4cd0-9730-c097b0981a7a service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received event network-vif-deleted-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:54 user nova-compute[70659]: INFO nova.compute.manager [req-892104ac-00aa-4d33-904f-12943a02e6ab req-e46a7870-b9fd-4cd0-9730-c097b0981a7a service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Neutron deleted interface b6b068df-7e92-4f25-b964-6c3492bcd6ec; detaching it from the instance and deleting it from the info cache
Jul 25 16:48:54 user nova-compute[70659]: DEBUG nova.network.neutron [req-892104ac-00aa-4d33-904f-12943a02e6ab req-e46a7870-b9fd-4cd0-9730-c097b0981a7a service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-892104ac-00aa-4d33-904f-12943a02e6ab req-e46a7870-b9fd-4cd0-9730-c097b0981a7a service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Detach interface failed, port_id=b6b068df-7e92-4f25-b964-6c3492bcd6ec, reason: Instance 7d47d257-3a12-48d8-bdb1-adec83869c41 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-71817344-b577-4b63-82c3-7fdee48f36b9 req-fefcc237-962e-4414-866c-e2480a215f0f service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received event network-vif-plugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-71817344-b577-4b63-82c3-7fdee48f36b9 req-fefcc237-962e-4414-866c-e2480a215f0f service nova] Acquiring lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-71817344-b577-4b63-82c3-7fdee48f36b9 req-fefcc237-962e-4414-866c-e2480a215f0f service nova] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-71817344-b577-4b63-82c3-7fdee48f36b9 req-fefcc237-962e-4414-866c-e2480a215f0f service nova] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-71817344-b577-4b63-82c3-7fdee48f36b9 req-fefcc237-962e-4414-866c-e2480a215f0f service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] No waiting events found dispatching network-vif-plugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:48:54 user nova-compute[70659]: WARNING nova.compute.manager [req-71817344-b577-4b63-82c3-7fdee48f36b9 req-fefcc237-962e-4414-866c-e2480a215f0f service nova] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Received unexpected event network-vif-plugged-b6b068df-7e92-4f25-b964-6c3492bcd6ec for instance with vm_state active and task_state deleting.
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:48:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:48:55 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:48:55 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:48:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:55 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Deleted allocations for instance 7d47d257-3a12-48d8-bdb1-adec83869c41
Jul 25 16:48:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-718b66e4-4f45-4ed4-8109-8d02ab7948df tempest-AttachSCSIVolumeTestJSON-732415869 tempest-AttachSCSIVolumeTestJSON-732415869-project-member] Lock "7d47d257-3a12-48d8-bdb1-adec83869c41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.985s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:48:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:48:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23761333638303665', 'path': '/dev/sdj'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:48:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761333638303665', 'path': '/dev/sdj'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:48:55 user nova-compute[70659]: DEBUG nova.objects.instance [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lazy-loading 'flavor' on Instance uuid 98c0757f-7146-48ea-ac36-e7c107e74d73 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:48:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:48:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 130023424 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:48:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 300941312 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:48:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 437256192 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:48:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 603979776 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:48:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:48:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 785383424 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 931135488 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTUEFiGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:48:59 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9922ce42-9e31-486b-ba52-29abc70e7db6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b24146-f132-48e9-8c8b-f40ae7ed6140]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:59 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:48:59 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:48:59 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd306cdc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'): ({'sdk'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Removing single pathed devices sdk {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea575aa-0e48-4504-b3db-25ba72780b2c]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df70e4-4455-4caa-b8de-f04723f3dc1f]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Flushing IO for device /dev/sdk {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[43811abd-4954-467f-9aad-01747094ed8e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c5495c-7210-43be-b37b-ad00477fbc0a]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] SCSI volumes sdk have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c908db1c-070b-4b06-8d16-abc6785e0120]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.119s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e43242-ca13-4cdb-9e53-9938631b5f39]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260]
Jul 25 16:48:59 user nova-compute[70659]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260] successful.
Jul 25 16:48:59 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:48:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d568e5ba-a318-4f45-93b6-4685f84b85fb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] <== disconnect_volume: return (375ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVYczKGl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '98c0757f-7146-48ea-ac36-e7c107e74d73', 'attached_at': '', 'detached_at': '', 'volume_id': '0468db03-65c8-42a3-851f-053f386ab726', 'serial'} {{(pid=70659) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 25 16:49:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] swap_volume: removing Cinder connection for volume 4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 {{(pid=70659) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 25 16:49:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] swap_volume: Updating volume 4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "WVYczKGl", "auth_password": "Nsoe7c8ASHM4RB", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "0468db03-65c8-42a3-851f-053f386ab726"}, "status": "reserved", "instance": "98c0757f-7146-48ea-ac36-e7c107e74d73", "attached_at": "", "detached_at": "", "volume_id": "0468db03-65c8-42a3-851f-053f386ab726", "serial": "0468db03-65c8-42a3-851f-053f386ab726"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0468db03-65c8-42a3-851f-053f386ab726', 'no_device': None, 'attachment_id': 'a8f97368-ef29-474a-9e74-d5d0a45359bc'} {{(pid=70659) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5176f7ff-5ad9-447c-b2c4-dc62e1e2fe06 tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.312s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG os_brick.utils [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-98894355-33ab-4529-8b6e-46ac8fe8e129 req-890f64be-87a6-4484-8b2a-ce81585cb984 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-changed-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-98894355-33ab-4529-8b6e-46ac8fe8e129 req-890f64be-87a6-4484-8b2a-ce81585cb984 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing instance network info cache due to event network-changed-a91425c6-074b-45e1-8529-fbc20abbeeb1. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-98894355-33ab-4529-8b6e-46ac8fe8e129 req-890f64be-87a6-4484-8b2a-ce81585cb984 service nova] Acquiring lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-98894355-33ab-4529-8b6e-46ac8fe8e129 req-890f64be-87a6-4484-8b2a-ce81585cb984 service nova] Acquired lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG nova.network.neutron [req-98894355-33ab-4529-8b6e-46ac8fe8e129 req-890f64be-87a6-4484-8b2a-ce81585cb984 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Refreshing network info cache for port a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2c8ad9-f30c-42d8-b229-761aac9fb24a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8acded-eb8c-4548-83b0-024ca5f0474d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9725377a-d8f3-4d4e-9297-fb095bec415e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70af2a1-a077-4091-8f7d-c3c4b5a9a5e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:49:01 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:49:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[345ad8ec-093f-497d-8ba7-1c7649a5541f]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:49:01 user nova-compute[70659]: DEBUG os_brick.utils [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:02 user nova-compute[70659]: INFO nova.compute.manager [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Swapping volume 0468db03-65c8-42a3-851f-053f386ab726 for 4631a1ff-4cfe-4c1f-8958-8232a8ca6c29
Jul 25 16:49:02 user nova-compute[70659]: DEBUG nova.network.neutron [req-98894355-33ab-4529-8b6e-46ac8fe8e129 req-890f64be-87a6-4484-8b2a-ce81585cb984 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updated VIF entry in instance network info cache for port a91425c6-074b-45e1-8529-fbc20abbeeb1. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:49:02 user nova-compute[70659]: DEBUG nova.network.neutron [req-98894355-33ab-4529-8b6e-46ac8fe8e129 req-890f64be-87a6-4484-8b2a-ce81585cb984 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [{"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-98894355-33ab-4529-8b6e-46ac8fe8e129 req-890f64be-87a6-4484-8b2a-ce81585cb984 service nova] Releasing lock "refresh_cache-f576940c-5074-4199-a850-8bf6bf9df4f5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:49:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:04 user nova-compute[70659]: INFO nova.compute.manager [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Terminating instance
Jul 25 16:49:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-8b43176e-c056-49ca-8fbb-f3d06a3da55d req-02d03a8e-e834-434a-b7b1-078383315b99 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8b43176e-c056-49ca-8fbb-f3d06a3da55d req-02d03a8e-e834-434a-b7b1-078383315b99 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8b43176e-c056-49ca-8fbb-f3d06a3da55d req-02d03a8e-e834-434a-b7b1-078383315b99 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8b43176e-c056-49ca-8fbb-f3d06a3da55d req-02d03a8e-e834-434a-b7b1-078383315b99 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-8b43176e-c056-49ca-8fbb-f3d06a3da55d req-02d03a8e-e834-434a-b7b1-078383315b99 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-unplugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-8b43176e-c056-49ca-8fbb-f3d06a3da55d req-02d03a8e-e834-434a-b7b1-078383315b99 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-335c0643-d7b0-46cb-8762-7687c146936a req-577bc8f3-a3ce-43da-b7a6-5ec83a2aa342 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-335c0643-d7b0-46cb-8762-7687c146936a req-577bc8f3-a3ce-43da-b7a6-5ec83a2aa342 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-335c0643-d7b0-46cb-8762-7687c146936a req-577bc8f3-a3ce-43da-b7a6-5ec83a2aa342 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-335c0643-d7b0-46cb-8762-7687c146936a req-577bc8f3-a3ce-43da-b7a6-5ec83a2aa342 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-335c0643-d7b0-46cb-8762-7687c146936a req-577bc8f3-a3ce-43da-b7a6-5ec83a2aa342 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-unplugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-335c0643-d7b0-46cb-8762-7687c146936a req-577bc8f3-a3ce-43da-b7a6-5ec83a2aa342 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Instance destroyed successfully.
Jul 25 16:49:05 user nova-compute[70659]: DEBUG nova.objects.instance [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lazy-loading 'resources' on Instance uuid f576940c-5074-4199-a850-8bf6bf9df4f5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:a2:a4,bridge_name='br-int',has_traffic_filtering=True,id=a91425c6-074b-45e1-8529-fbc20abbeeb1,network=Network(041869d8-93c8-4ce2-b28d-415ec901af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa91425c6-07') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:a2:a4,bridge_name='br-int',has_traffic_filtering=True,id=a91425c6-074b-45e1-8529-fbc20abbeeb1,network=Network(041869d8-93c8-4ce2-b28d-415ec901af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa91425c6-07') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa91425c6-07, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: INFO os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:a2:a4,bridge_name='br-int',has_traffic_filtering=True,id=a91425c6-074b-45e1-8529-fbc20abbeeb1,network=Network(041869d8-93c8-4ce2-b28d-415ec901af04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa91425c6-07')
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=8307269f-4c27-4543-9d41-e39fc9e555d6,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8307269f-4c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=8307269f-4c27-4543-9d41-e39fc9e555d6,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8307269f-4c') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8307269f-4c, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: INFO os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=8307269f-4c27-4543-9d41-e39fc9e555d6,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8307269f-4c')
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:2f:ef,bridge_name='br-int',has_traffic_filtering=True,id=626d85e1-6b0c-4bb9-aaed-bcfdad48ed57,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap626d85e1-6b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:2f:ef,bridge_name='br-int',has_traffic_filtering=True,id=626d85e1-6b0c-4bb9-aaed-bcfdad48ed57,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap626d85e1-6b') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap626d85e1-6b, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: INFO os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:2f:ef,bridge_name='br-int',has_traffic_filtering=True,id=626d85e1-6b0c-4bb9-aaed-bcfdad48ed57,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap626d85e1-6b')
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:47,bridge_name='br-int',has_traffic_filtering=True,id=56599ea4-5413-4adb-ab9b-a47b3d5ed020,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56599ea4-54') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:47,bridge_name='br-int',has_traffic_filtering=True,id=56599ea4-5413-4adb-ab9b-a47b3d5ed020,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56599ea4-54') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56599ea4-54, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: INFO os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:38:47,bridge_name='br-int',has_traffic_filtering=True,id=56599ea4-5413-4adb-ab9b-a47b3d5ed020,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56599ea4-54')
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:12:5b,bridge_name='br-int',has_traffic_filtering=True,id=7d6092df-2c0e-4f9e-ae16-a8282dc45f03,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d6092df-2c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:12:5b,bridge_name='br-int',has_traffic_filtering=True,id=7d6092df-2c0e-4f9e-ae16-a8282dc45f03,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d6092df-2c') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d6092df-2c, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-4b2f14ea-89cc-4c2e-85fc-ffc703313665 req-c507ccf6-99de-4a6a-9cc3-72cd4f2c2bf8 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-changed-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-4b2f14ea-89cc-4c2e-85fc-ffc703313665 req-c507ccf6-99de-4a6a-9cc3-72cd4f2c2bf8 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing instance network info cache due to event network-changed-a81b2274-5695-4d3e-9543-b8b1f24ab8d9. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4b2f14ea-89cc-4c2e-85fc-ffc703313665 req-c507ccf6-99de-4a6a-9cc3-72cd4f2c2bf8 service nova] Acquiring lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4b2f14ea-89cc-4c2e-85fc-ffc703313665 req-c507ccf6-99de-4a6a-9cc3-72cd4f2c2bf8 service nova] Acquired lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-4b2f14ea-89cc-4c2e-85fc-ffc703313665 req-c507ccf6-99de-4a6a-9cc3-72cd4f2c2bf8 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Refreshing network info cache for port a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: INFO os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:12:5b,bridge_name='br-int',has_traffic_filtering=True,id=7d6092df-2c0e-4f9e-ae16-a8282dc45f03,network=Network(6b6071ef-ee7f-4668-a450-b9fe23a1d572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d6092df-2c')
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "address": "fa:16:3e:06:24:d5", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073a9571-bc", "ovs_interfaceid": "073a9571-bc46-4f6b-bccd-262a6e05a4c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:24:d5,bridge_name='br-int',has_traffic_filtering=True,id=073a9571-bc46-4f6b-bccd-262a6e05a4c5,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073a9571-bc') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:24:d5,bridge_name='br-int',has_traffic_filtering=True,id=073a9571-bc46-4f6b-bccd-262a6e05a4c5,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073a9571-bc') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap073a9571-bc, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: INFO os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:24:d5,bridge_name='br-int',has_traffic_filtering=True,id=073a9571-bc46-4f6b-bccd-262a6e05a4c5,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073a9571-bc')
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087783692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087783692',id=11,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk0Gmb/i3Yc24aUQiCLKQL+7uwJjVnRtejAQk04kL7sgs/A/7jTI+nQFOO68oUKmlX3kP+9uj4Hhte+OlMyW1Yk1eS9Zcm5RJUfhfBly4xVhAFnk3lEWDlaSSds6tILqQ==',key_name='tempest-keypair-1488714836',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fb6ec6679fa44c4934e4bb8a6478920',ramdisk_id='',reservation_id='r-a8ay0bpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1036210835',owner_user_name='tempest-TaggedBootDevicesTest-1036210835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5e52d7ac7064f41977498f4d771169c',uuid=f576940c-5074-4199-a850-8bf6bf9df4f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converting VIF {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:20:76,bridge_name='br-int',has_traffic_filtering=True,id=a0c96475-3d0a-4f2b-9916-19084a41ad14,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c96475-3d') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:20:76,bridge_name='br-int',has_traffic_filtering=True,id=a0c96475-3d0a-4f2b-9916-19084a41ad14,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c96475-3d') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0c96475-3d, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:06 user nova-compute[70659]: INFO os_vif [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:20:76,bridge_name='br-int',has_traffic_filtering=True,id=a0c96475-3d0a-4f2b-9916-19084a41ad14,network=Network(f8450273-5cf6-4a99-a724-53bbdcf6dcba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c96475-3d')
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIkfGqxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:06 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bbbd72-a155-466c-92e0-6f3afd06d24d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7c573a-8177-4d18-98e7-472996abc2a0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:06 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:06 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd303dcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5563dd2-b505-487a-9022-438e6cffb842]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dbd51c-6869-48a4-b364-7d920b9f4f0e]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb9fe85-3c10-4a12-a5fc-ba01aef2f9cb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b97ceb-ebbf-4933-8d8c-7c069088675f]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[534e8e5f-35c3-4a58-bf11-cd9db1498db5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea7c80e-2f49-4984-8dec-226ce0cd9d4d]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233, portal: 172.16.0.220,3260]
Jul 25 16:49:06 user nova-compute[70659]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:06 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b06b74c-55d9-4002-8dc4-1614fcad7233 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1c22b1-5e48-4016-9a8d-2df820d7ff53]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] <== disconnect_volume: return (364ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybwAhesk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:06 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[472f16df-15bc-4075-a3fd-2faae44185f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e804ea4a-9c5c-4ada-9247-f04a0835f100]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:06 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:06 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:06 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd303dcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186'): ({'sdc'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Removing single pathed devices sdc {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[333c2214-8987-4096-8a79-40e81a786aeb]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[049a4f29-1b9b-4b80-9cf4-6aa200cebda7]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Flushing IO for device /dev/sdc {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[49937d8c-e999-407d-9de3-bc0d97d213b3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:06 user nova-compute[70659]: WARNING nova.compute.manager [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-56599ea4-5413-4adb-ab9b-a47b3d5ed020 for instance with vm_state active and task_state deleting.
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-unplugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:06 user nova-compute[70659]: WARNING nova.compute.manager [req-20719ec0-1d90-4f77-90e5-67cdfdde3f35 req-4ce059bb-7e70-4120-a043-18dd937fbae3 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-a0c96475-3d0a-4f2b-9916-19084a41ad14 for instance with vm_state active and task_state deleting.
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe01efae-aaef-47b4-9e58-b2be47347376]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[989391dc-1d6a-49af-bcf7-eb68e1099b50]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[914573a2-93bf-41c9-8258-c9f7c166419f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186, portal: 172.16.0.220,3260]
Jul 25 16:49:07 user nova-compute[70659]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:07 user nova-compute[70659]: WARNING nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-a91425c6-074b-45e1-8529-fbc20abbeeb1 for instance with vm_state active and task_state deleting.
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-unplugged-8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-8307269f-4c27-4543-9d41-e39fc9e555d6 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-8307269f-4c27-4543-9d41-e39fc9e555d6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:07 user nova-compute[70659]: WARNING nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-8307269f-4c27-4543-9d41-e39fc9e555d6 for instance with vm_state active and task_state deleting.
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-unplugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-5acb5fad-05c7-4e1a-8b55-a1d27422fa41 req-23fd7559-a7c4-4f42-b23c-9cb2196d97a8 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd44b09-c1f9-4da3-baf7-1d3b9ca64186 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af33489-1959-4c43-bbc5-c25d8f89fd8b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] <== disconnect_volume: return (330ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJQsLytj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:07 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac382f6-6a4b-442c-9e2e-eb09610dc5b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4742499b-ac84-403b-a60e-529d6761b25b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:07 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd303a3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa'): ({'sde'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Removing single pathed devices sde {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6807d0-d696-4c25-9f3c-35c2d69da057]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd99ae-a586-4e45-9a42-cbd3181e43a4]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Flushing IO for device /dev/sde {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd40d1f1-e8c2-4ff9-83ac-13c05279a89d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec9d03f-3e79-4355-9c1c-586792b7574f]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68d5b07-361e-45b5-b428-21906fec4755]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d4107-6d8e-4ee6-9cce-37711b7b741a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa, portal: 172.16.0.220,3260]
Jul 25 16:49:07 user nova-compute[70659]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b923f544-5fb0-4844-8f81-115be6bcb6aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4403da3e-976b-49cb-a732-6349db57768a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] <== disconnect_volume: return (341ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Deleting instance files /opt/stack/data/nova/instances/f576940c-5074-4199-a850-8bf6bf9df4f5_del
Jul 25 16:49:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Deletion of /opt/stack/data/nova/instances/f576940c-5074-4199-a850-8bf6bf9df4f5_del complete
Jul 25 16:49:07 user nova-compute[70659]: INFO nova.compute.manager [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Took 3.36 seconds to destroy the instance on the hypervisor.
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.network.neutron [req-4b2f14ea-89cc-4c2e-85fc-ffc703313665 req-c507ccf6-99de-4a6a-9cc3-72cd4f2c2bf8 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updated VIF entry in instance network info cache for port a81b2274-5695-4d3e-9543-b8b1f24ab8d9. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG nova.network.neutron [req-4b2f14ea-89cc-4c2e-85fc-ffc703313665 req-c507ccf6-99de-4a6a-9cc3-72cd4f2c2bf8 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [{"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4b2f14ea-89cc-4c2e-85fc-ffc703313665 req-c507ccf6-99de-4a6a-9cc3-72cd4f2c2bf8 service nova] Releasing lock "refresh_cache-0801e7d7-36b9-4e3d-919d-0728ae2e2c29" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:49:08 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303733.123137, 7d47d257-3a12-48d8-bdb1-adec83869c41 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:49:08 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] VM Stopped (Lifecycle Event)
Jul 25 16:49:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-356ee2ab-f265-4c88-8920-c3a514161510 None None] [instance: 7d47d257-3a12-48d8-bdb1-adec83869c41] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:49:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:08 user nova-compute[70659]: INFO nova.compute.manager [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Terminating instance
Jul 25 16:49:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:49:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:09 user nova-compute[70659]: WARNING nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-626d85e1-6b0c-4bb9-aaed-bcfdad48ed57 for instance with vm_state active and task_state deleting.
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-unplugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:09 user nova-compute[70659]: WARNING nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 for instance with vm_state active and task_state deleting.
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-unplugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-unplugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-plugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Acquiring lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] No waiting events found dispatching network-vif-plugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:09 user nova-compute[70659]: WARNING nova.compute.manager [req-bae875f7-af99-4bde-bcef-e391a9233181 req-0b6a53ed-afd4-454b-a6b3-91f154045483 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received unexpected event network-vif-plugged-073a9571-bc46-4f6b-bccd-262a6e05a4c5 for instance with vm_state active and task_state deleting.
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-cfd8fa66-707d-4ab3-9c3c-d917096923a1 req-f982d2d4-7a24-47da-8355-65fb7d1c872f service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cfd8fa66-707d-4ab3-9c3c-d917096923a1 req-f982d2d4-7a24-47da-8355-65fb7d1c872f service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cfd8fa66-707d-4ab3-9c3c-d917096923a1 req-f982d2d4-7a24-47da-8355-65fb7d1c872f service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cfd8fa66-707d-4ab3-9c3c-d917096923a1 req-f982d2d4-7a24-47da-8355-65fb7d1c872f service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-cfd8fa66-707d-4ab3-9c3c-d917096923a1 req-f982d2d4-7a24-47da-8355-65fb7d1c872f service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-unplugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-cfd8fa66-707d-4ab3-9c3c-d917096923a1 req-f982d2d4-7a24-47da-8355-65fb7d1c872f service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Instance destroyed successfully.
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lazy-loading 'resources' on Instance uuid 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:87:67,bridge_name='br-int',has_traffic_filtering=True,id=a81b2274-5695-4d3e-9543-b8b1f24ab8d9,network=Network(42ed7322-c794-467c-999f-c4c43ed2e7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b2274-56') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:87:67,bridge_name='br-int',has_traffic_filtering=True,id=a81b2274-5695-4d3e-9543-b8b1f24ab8d9,network=Network(42ed7322-c794-467c-999f-c4c43ed2e7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b2274-56') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa81b2274-56, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-unplugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:11 user nova-compute[70659]: WARNING nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 for instance with vm_state active and task_state deleting.
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-unplugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:11 user nova-compute[70659]: WARNING nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-3a834d3c-ee6d-4582-bee2-3da76e26cbca for instance with vm_state active and task_state deleting.
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-unplugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:11 user nova-compute[70659]: WARNING nova.compute.manager [req-18adeb72-5ce1-42a4-9158-cd5833b49548 req-a4a37696-52e0-4d5f-8acc-d05c9917a499 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-ccd6efc2-4bf4-4af9-9f85-bb175b743b0b for instance with vm_state active and task_state deleting.
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTUEFiGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98c0757f-7146-48ea-ac36-e7c107e74d73', 'attached_at': '', 'detached_at': '', 'volume_id': '4631a1ff-4cfe-4c1f-8958-8232a8ca6c29', 'serial': '4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVYczKGl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '0468db03-65c8-42a3-851f-053f386ab726'}, 'status': 'reserved', 'instance': '98c0757f-7146-48ea-ac36-e7c107e74d73', 'attached_at': '', 'detached_at': '', 'volume_id': '0468db03-65c8-42a3-851f-053f386ab726', 'serial'} {{(pid=70659) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTUEFiGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:11 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:11 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:11 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: INFO os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:87:67,bridge_name='br-int',has_traffic_filtering=True,id=a81b2274-5695-4d3e-9543-b8b1f24ab8d9,network=Network(42ed7322-c794-467c-999f-c4c43ed2e7e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b2274-56')
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:e1:d2,bridge_name='br-int',has_traffic_filtering=True,id=3a834d3c-ee6d-4582-bee2-3da76e26cbca,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a834d3c-ee') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:e1:d2,bridge_name='br-int',has_traffic_filtering=True,id=3a834d3c-ee6d-4582-bee2-3da76e26cbca,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a834d3c-ee') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a834d3c-ee, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260" returned: 21 in 0.096s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2e7eaa-fb56-4056-9276-f024a7026290]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:49:11 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c042871-fd20-4983-88c3-1df81e4fdab4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29] added
Jul 25 16:49:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4909e6-83ee-43cd-9193-f1f76da48973]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: INFO os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:e1:d2,bridge_name='br-int',has_traffic_filtering=True,id=3a834d3c-ee6d-4582-bee2-3da76e26cbca,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a834d3c-ee')
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:77:3a,bridge_name='br-int',has_traffic_filtering=True,id=ccd6efc2-4bf4-4af9-9f85-bb175b743b0b,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapccd6efc2-4b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:77:3a,bridge_name='br-int',has_traffic_filtering=True,id=ccd6efc2-4bf4-4af9-9f85-bb175b743b0b,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapccd6efc2-4b') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccd6efc2-4b, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e10bf66-4c99-4e29-8127-83756ab4e516]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTUEFiGp {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTUEFiGp" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[993d8a91-9b15-4c69-b33c-afaf135576db]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTUEFiGp'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: INFO os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:77:3a,bridge_name='br-int',has_traffic_filtering=True,id=ccd6efc2-4bf4-4af9-9f85-bb175b743b0b,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapccd6efc2-4b')
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:8b,bridge_name='br-int',has_traffic_filtering=True,id=15c30d3d-d8ea-45e9-9c38-524a09f264ef,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c30d3d-d8') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:8b,bridge_name='br-int',has_traffic_filtering=True,id=15c30d3d-d8ea-45e9-9c38-524a09f264ef,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c30d3d-d8') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15c30d3d-d8, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc4f7f1-64c6-48d1-b78c-cdfc5306ff99]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d25e3e-38c1-4e96-8dde-66b644818367]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:11 user nova-compute[70659]: INFO os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:8b,bridge_name='br-int',has_traffic_filtering=True,id=15c30d3d-d8ea-45e9-9c38-524a09f264ef,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c30d3d-d8')
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fd:f5,bridge_name='br-int',has_traffic_filtering=True,id=0f88fc9a-7a42-4ba4-921c-3f7a010fb264,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88fc9a-7a') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fd:f5,bridge_name='br-int',has_traffic_filtering=True,id=0f88fc9a-7a42-4ba4-921c-3f7a010fb264,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88fc9a-7a') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f88fc9a-7a, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: INFO os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fd:f5,bridge_name='br-int',has_traffic_filtering=True,id=0f88fc9a-7a42-4ba4-921c-3f7a010fb264,network=Network(058d3755-8cc4-496b-8efb-0277e4f7376e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88fc9a-7a')
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6b:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a328118-fec0-49c6-be72-e9274767e4fb,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a328118-fe') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6b:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a328118-fec0-49c6-be72-e9274767e4fb,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a328118-fe') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a328118-fe, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: INFO os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6b:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a328118-fec0-49c6-be72-e9274767e4fb,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a328118-fe')
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1172446140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1172446140',id=12,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzOvnXB3cCVZxh23WObXycJ08NiXfzNdGbEeGkspDm3ytOyqgzSSD7Kik+PyARQNK0zrOOQewyJ6R+GlQGFKD5HyuJbH+zMc1OSBwHaE9G/kYhRC5eJu2mJz8h7BZUzxg==',key_name='tempest-keypair-1304454087',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b0e568f9df34d918c1684e2e93ad659',ramdisk_id='',reservation_id='r-kkmdw6hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-858302614',owner_user_name='tempest-TaggedBootDevicesTest_v242-858302614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ffbc9e4ab54d1a98a0bdfddb7b9868',uuid=0801e7d7-36b9-4e3d-919d-0728ae2e2c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converting VIF {"id": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "address": "fa:16:3e:8d:4a:db", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa12f95a9-42", "ovs_interfaceid": "a12f95a9-424d-4b5b-8c31-54eac1e2c3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=a12f95a9-424d-4b5b-8c31-54eac1e2c3ed,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa12f95a9-42') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=a12f95a9-424d-4b5b-8c31-54eac1e2c3ed,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa12f95a9-42') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa12f95a9-42, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:11 user nova-compute[70659]: INFO os_vif [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:db,bridge_name='br-int',has_traffic_filtering=True,id=a12f95a9-424d-4b5b-8c31-54eac1e2c3ed,network=Network(a02e6f5c-b202-4da9-96b4-bdcd256dcb5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa12f95a9-42')
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eec32a1-3bb1-44b1-a997-03d773678999]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260]
Jul 25 16:49:11 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkwKAtNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:11 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[646f4280-24f3-4b95-96f2-7b2e1c486981]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6f5a19-ac71-43a7-b4b0-295a412304e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:11 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5509928e-8671-4eae-8d66-616b90678e8f]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:12 user nova-compute[70659]: WARNING nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 for instance with vm_state active and task_state deleting.
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-deleted-073a9571-bc46-4f6b-bccd-262a6e05a4c5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:12 user nova-compute[70659]: INFO nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Neutron deleted interface 073a9571-bc46-4f6b-bccd-262a6e05a4c5; detaching it from the instance and deleting it from the info cache
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.network.neutron [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [{"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "address": "fa:16:3e:58:12:5b", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d6092df-2c", "ovs_interfaceid": "7d6092df-2c0e-4f9e-ae16-a8282dc45f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Detach interface failed, port_id=073a9571-bc46-4f6b-bccd-262a6e05a4c5, reason: Instance f576940c-5074-4199-a850-8bf6bf9df4f5 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-unplugged-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-2a328118-fec0-49c6-be72-e9274767e4fb for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-deleted-7d6092df-2c0e-4f9e-ae16-a8282dc45f03 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:12 user nova-compute[70659]: INFO nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Neutron deleted interface 7d6092df-2c0e-4f9e-ae16-a8282dc45f03; detaching it from the instance and deleting it from the info cache
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.network.neutron [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [{"id": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "address": "fa:16:3e:5a:a2:a4", "network": {"id": "041869d8-93c8-4ce2-b28d-415ec901af04", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1090187299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa91425c6-07", "ovs_interfaceid": "a91425c6-074b-45e1-8529-fbc20abbeeb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8307269f-4c27-4543-9d41-e39fc9e555d6", "address": "fa:16:3e:f0:bb:ee", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8307269f-4c", "ovs_interfaceid": "8307269f-4c27-4543-9d41-e39fc9e555d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "address": "fa:16:3e:72:2f:ef", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626d85e1-6b", "ovs_interfaceid": "626d85e1-6b0c-4bb9-aaed-bcfdad48ed57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "address": "fa:16:3e:63:38:47", "network": {"id": "6b6071ef-ee7f-4668-a450-b9fe23a1d572", "bridge": "br-int", "label": "tempest-device-tagging-net1-21745444", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56599ea4-54", "ovs_interfaceid": "56599ea4-5413-4adb-ab9b-a47b3d5ed020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "address": "fa:16:3e:3a:20:76", "network": {"id": "f8450273-5cf6-4a99-a724-53bbdcf6dcba", "bridge": "br-int", "label": "tempest-device-tagging-net2-1452037580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3fb6ec6679fa44c4934e4bb8a6478920", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c96475-3d", "ovs_interfaceid": "a0c96475-3d0a-4f2b-9916-19084a41ad14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Detach interface failed, port_id=7d6092df-2c0e-4f9e-ae16-a8282dc45f03, reason: Instance f576940c-5074-4199-a850-8bf6bf9df4f5 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:12 user nova-compute[70659]: WARNING nova.compute.manager [req-9c3709d6-2fcb-412f-9d58-cbdfa7abcc74 req-392c2591-edf9-42f6-acea-c4cab7542459 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-2a328118-fec0-49c6-be72-e9274767e4fb for instance with vm_state active and task_state deleting.
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTUEFiGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '23162326232383231', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162326232383231', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.103s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lazy-loading 'flavor' on Instance uuid 98c0757f-7146-48ea-ac36-e7c107e74d73 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3d6746-3641-4efe-8b10-7b8df9ce3373]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab486042-8f04-4154-8bfc-5eb6dc393d1c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:12 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:12 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:12 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30637d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e'): ({'sdd'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Removing single pathed devices sdd {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:49:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[217ee9bf-f4e0-41c2-8ccc-2d4bfb8bc41d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.068s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c187802-2432-486c-8d65-9036f0fea2bb]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Flushing IO for device /dev/sdd {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.033s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d67507-f367-4bea-9e30-5f61a6e5ff34]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8c00bc-75e5-4d9d-9b53-25a24c55d3f5]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c05945-1c03-4d33-8d11-65a5d3938a11]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f746723-29af-4b88-adf2-225e9140c8e2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e, portal: 172.16.0.220,3260]
Jul 25 16:49:13 user nova-compute[70659]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:13 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f44b4d-b14d-4f3f-a012-1fb73e1f805e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3620199f-ab8e-454c-814e-d739676d5dad]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] <== disconnect_volume: return (1516ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHVOEBXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:13 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-unplugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:13 user nova-compute[70659]: WARNING nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-15c30d3d-d8ea-45e9-9c38-524a09f264ef for instance with vm_state active and task_state deleting.
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-unplugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-unplugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-plugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Acquiring lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] No waiting events found dispatching network-vif-plugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:13 user nova-compute[70659]: WARNING nova.compute.manager [req-362bfac8-8e8d-4c71-866a-297c7b893862 req-914f8d2c-6843-4b75-a26b-65f382227a31 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received unexpected event network-vif-plugged-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed for instance with vm_state active and task_state deleting.
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be695f4-8245-4fe9-99e6-d037cfca8f31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b518a5fb-2ef0-409b-8314-322b5dfce76f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:13 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:13 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30584280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7'): ({'sdf'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Removing single pathed devices sdf {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2908a3-b8d4-4772-853c-37075d2fab46]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d1ba4c-813b-41a9-b131-ae2a011e01ac]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Flushing IO for device /dev/sdf {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a68e7b-deda-4be3-95ec-9958c1e04ba9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b0b1d0-aab7-4fde-99c6-a8fa25281a87]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5797b1a6-a601-4308-85eb-62fa01a2edb0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:13 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Took 6.08 seconds to deallocate network for instance.
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5687098-a53f-4e59-8fb3-cd17b8c222db]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7, portal: 172.16.0.220,3260]
Jul 25 16:49:13 user nova-compute[70659]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:13 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288bdf65-622e-4e9b-a7cc-d375ced26cb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3a076f-9525-4029-b22f-ccee57c1b976]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] <== disconnect_volume: return (421ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwzfpJMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:13 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d675628-968b-4bc0-af40-47beca0c14f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e93705-2c9e-4635-972b-9b8aa406f14c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:13 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 (non-flash)
Jul 25 16:49:13 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:13 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30584280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709'): ({'sdg'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Removing single pathed devices sdg {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.042s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e801e3-83da-42cb-90dc-a447eee63243]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.036s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d36b7f0-b2b2-4c6f-9d30-8976a329e117]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Flushing IO for device /dev/sdg {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad76014-1137-4a6d-baa3-71c79f091573]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:49:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e907421-1128-4af8-a27b-0b6b8fdb0209]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] SCSI volumes sdg have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d56257-b4ec-41b4-bdce-5c7095125484]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c405c8-c914-49c5-9069-df37510f2466]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709, portal: 172.16.0.220,3260]
Jul 25 16:49:14 user nova-compute[70659]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:14 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-d2a201b3-b010-42f8-ac88-89799696e88b req-4c9303db-dcc1-476b-b703-3fae352d689e service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-deleted-a91425c6-074b-45e1-8529-fbc20abbeeb1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-d2a201b3-b010-42f8-ac88-89799696e88b req-4c9303db-dcc1-476b-b703-3fae352d689e service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-deleted-a0c96475-3d0a-4f2b-9916-19084a41ad14 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-d2a201b3-b010-42f8-ac88-89799696e88b req-4c9303db-dcc1-476b-b703-3fae352d689e service nova] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Received event network-vif-deleted-56599ea4-5413-4adb-ab9b-a47b3d5ed020 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfddbd88-c48e-47d3-a732-5790aa980709 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b81504-eaee-449c-a76e-86bd7ea29112]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] <== disconnect_volume: return (427ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:14 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Deleting instance files /opt/stack/data/nova/instances/0801e7d7-36b9-4e3d-919d-0728ae2e2c29_del
Jul 25 16:49:14 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Deletion of /opt/stack/data/nova/instances/0801e7d7-36b9-4e3d-919d-0728ae2e2c29_del complete
Jul 25 16:49:14 user nova-compute[70659]: INFO nova.compute.manager [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Took 5.45 seconds to destroy the instance on the hypervisor.
Jul 25 16:49:14 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 305135616 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 444596224 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 598736896 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 724566016 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 856686592 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-6a7e0916-f52a-46fe-bcd2-1dd270ca4ba4 req-be84f873-e921-4868-9e23-a57d010c4f1d service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-deleted-a12f95a9-424d-4b5b-8c31-54eac1e2c3ed {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:16 user nova-compute[70659]: INFO nova.compute.manager [req-6a7e0916-f52a-46fe-bcd2-1dd270ca4ba4 req-be84f873-e921-4868-9e23-a57d010c4f1d service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Neutron deleted interface a12f95a9-424d-4b5b-8c31-54eac1e2c3ed; detaching it from the instance and deleting it from the info cache
Jul 25 16:49:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-6a7e0916-f52a-46fe-bcd2-1dd270ca4ba4 req-be84f873-e921-4868-9e23-a57d010c4f1d service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [{"id": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "address": "fa:16:3e:b9:87:67", "network": {"id": "42ed7322-c794-467c-999f-c4c43ed2e7e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1539709536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b2274-56", "ovs_interfaceid": "a81b2274-5695-4d3e-9543-b8b1f24ab8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 963641344 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-6a7e0916-f52a-46fe-bcd2-1dd270ca4ba4 req-be84f873-e921-4868-9e23-a57d010c4f1d service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Detach interface failed, port_id=a12f95a9-424d-4b5b-8c31-54eac1e2c3ed, reason: Instance 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:49:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 1040187392 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:17 user nova-compute[70659]: INFO nova.compute.manager [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Took 4.38 seconds to detach 3 volumes for instance.
Jul 25 16:49:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVYczKGl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '0468db03-65c8-42a3-851f-053f386ab726'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:18 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae7f399-b7fe-413d-9af1-9fc6b72e6ff7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6962f-024b-4d8e-960f-8a7aa9f803e3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:18 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:18 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:18 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:18 user nova-compute[70659]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 (non-flash)
Jul 25 16:49:18 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:18 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd36d7fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726'): ({'sdj'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Removing single pathed devices sdj {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1891ee11-951a-4492-8c92-234d387bdef1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca66edd-093c-4642-b89f-0eef340bb263]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Flushing IO for device /dev/sdj {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[20de2481-a5cc-4993-8d1e-0c12b9b0797e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a850781-3cd3-4358-a259-2c362c2d40c3]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] SCSI volumes sdj have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a056c-62e1-46ae-aced-35f0772972e6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3560af11-a8a6-4742-a710-9a99607b9b67]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726, portal: 172.16.0.220,3260]
Jul 25 16:49:18 user nova-compute[70659]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0468db03-65c8-42a3-851f-053f386ab726 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790009e-4da2-4d30-98ad-6b03c677ac4c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] <== disconnect_volume: return (319ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTUEFiGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '98c0757f-7146-48ea-ac36-e7c107e74d73', 'attached_at': '', 'detached_at': '', 'volume_id': '4631a1ff-4cfe-4c1f-8958-8232a8ca6c29', 'serial'} {{(pid=70659) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 25 16:49:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] swap_volume: removing Cinder connection for volume 0468db03-65c8-42a3-851f-053f386ab726 {{(pid=70659) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 25 16:49:18 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Deleted allocations for instance f576940c-5074-4199-a850-8bf6bf9df4f5
Jul 25 16:49:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc0c6755-2855-4e37-bada-f8781c679a5f tempest-TaggedBootDevicesTest-1036210835 tempest-TaggedBootDevicesTest-1036210835-project-member] Lock "f576940c-5074-4199-a850-8bf6bf9df4f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.560s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-deleted-a81b2274-5695-4d3e-9543-b8b1f24ab8d9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:19 user nova-compute[70659]: INFO nova.compute.manager [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Neutron deleted interface a81b2274-5695-4d3e-9543-b8b1f24ab8d9; detaching it from the instance and deleting it from the info cache
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [{"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "address": "fa:16:3e:7f:fd:f5", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88fc9a-7a", "ovs_interfaceid": "0f88fc9a-7a42-4ba4-921c-3f7a010fb264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Detach interface failed, port_id=a81b2274-5695-4d3e-9543-b8b1f24ab8d9, reason: Instance 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-deleted-0f88fc9a-7a42-4ba4-921c-3f7a010fb264 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:19 user nova-compute[70659]: INFO nova.compute.manager [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Neutron deleted interface 0f88fc9a-7a42-4ba4-921c-3f7a010fb264; detaching it from the instance and deleting it from the info cache
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [{"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a328118-fec0-49c6-be72-e9274767e4fb", "address": "fa:16:3e:47:6b:1a", "network": {"id": "a02e6f5c-b202-4da9-96b4-bdcd256dcb5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-502354641", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a328118-fe", "ovs_interfaceid": "2a328118-fec0-49c6-be72-e9274767e4fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Detach interface failed, port_id=0f88fc9a-7a42-4ba4-921c-3f7a010fb264, reason: Instance 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-deleted-2a328118-fec0-49c6-be72-e9274767e4fb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:19 user nova-compute[70659]: INFO nova.compute.manager [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Neutron deleted interface 2a328118-fec0-49c6-be72-e9274767e4fb; detaching it from the instance and deleting it from the info cache
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [{"id": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "address": "fa:16:3e:29:e1:d2", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a834d3c-ee", "ovs_interfaceid": "3a834d3c-ee6d-4582-bee2-3da76e26cbca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "address": "fa:16:3e:8a:77:3a", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd6efc2-4b", "ovs_interfaceid": "ccd6efc2-4bf4-4af9-9f85-bb175b743b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "address": "fa:16:3e:26:a7:8b", "network": {"id": "058d3755-8cc4-496b-8efb-0277e4f7376e", "bridge": "br-int", "label": "tempest-device-tagging-net1-781577210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b0e568f9df34d918c1684e2e93ad659", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c30d3d-d8", "ovs_interfaceid": "15c30d3d-d8ea-45e9-9c38-524a09f264ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-718c1863-b30e-4610-b8c7-60d8a10a0e6e req-415936cf-6f41-4caf-ba7f-c45b43c2b6b5 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Detach interface failed, port_id=2a328118-fec0-49c6-be72-e9274767e4fb, reason: Instance 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:19 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Took 4.91 seconds to deallocate network for instance.
Jul 25 16:49:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] swap_volume: Updating volume 0468db03-65c8-42a3-851f-053f386ab726 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "BTUEFiGp", "auth_password": "GAdQVkMFEJ2w7c", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "4631a1ff-4cfe-4c1f-8958-8232a8ca6c29"}, "status": "reserved", "instance": "98c0757f-7146-48ea-ac36-e7c107e74d73", "attached_at": "", "detached_at": "", "volume_id": "4631a1ff-4cfe-4c1f-8958-8232a8ca6c29", "serial": "4631a1ff-4cfe-4c1f-8958-8232a8ca6c29"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4631a1ff-4cfe-4c1f-8958-8232a8ca6c29', 'no_device': None, 'attachment_id': '190a9756-7b89-4e3b-8509-76ef2613947e'} {{(pid=70659) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 25 16:49:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b8e81367-2299-4291-bb28-e62485323a7b tempest-TestVolumeSwap-113943212 tempest-TestVolumeSwap-113943212-project-admin] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.783s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:20 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303745.911474, f576940c-5074-4199-a850-8bf6bf9df4f5 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:49:20 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] VM Stopped (Lifecycle Event)
Jul 25 16:49:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-40fe285c-1c23-4904-bbcc-dda424718754 None None] [instance: f576940c-5074-4199-a850-8bf6bf9df4f5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:49:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:20 user nova-compute[70659]: INFO nova.compute.manager [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Detaching volume 4631a1ff-4cfe-4c1f-8958-8232a8ca6c29
Jul 25 16:49:21 user nova-compute[70659]: INFO nova.virt.block_device [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Attempting to driver detach volume 4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 from mountpoint /dev/vdb
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Attempting to detach device vdb from instance 98c0757f-7146-48ea-ac36-e7c107e74d73 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:49:21 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:49:21 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:49:21 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:49:21 user nova-compute[70659]:   <serial>4631a1ff-4cfe-4c1f-8958-8232a8ca6c29</serial>
Jul 25 16:49:21 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:49:21 user nova-compute[70659]: </disk>
Jul 25 16:49:21 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:49:21 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Successfully detached device vdb from instance 98c0757f-7146-48ea-ac36-e7c107e74d73 from the persistent domain config.
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98c0757f-7146-48ea-ac36-e7c107e74d73 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:49:21 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:49:21 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:49:21 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:49:21 user nova-compute[70659]:   <serial>4631a1ff-4cfe-4c1f-8958-8232a8ca6c29</serial>
Jul 25 16:49:21 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:49:21 user nova-compute[70659]: </disk>
Jul 25 16:49:21 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-99fe5fc3-5277-4988-b1e2-ea7122070499 req-78c4aa2d-94db-45e6-89fc-fde04fd708e9 service nova] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Received event network-vif-deleted-15c30d3d-d8ea-45e9-9c38-524a09f264ef {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690303761.5735204, 98c0757f-7146-48ea-ac36-e7c107e74d73 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98c0757f-7146-48ea-ac36-e7c107e74d73 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:49:21 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Successfully detached device vdb from instance 98c0757f-7146-48ea-ac36-e7c107e74d73 from the live domain config.
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTUEFiGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:21 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d680c4e1-f2bb-4969-a4eb-70dbf328475b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:21 user nova-compute[70659]: INFO nova.compute.manager [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Took 2.44 seconds to detach 3 volumes for instance.
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97227f8-8a1f-4fa6-aab3-716fde3f8184]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:21 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:21 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:21 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:21 user nova-compute[70659]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 (non-flash)
Jul 25 16:49:21 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:21 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd36da0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21ab60c-1288-4816-9e20-7a9979865706]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe93e6-42db-4c91-80dc-12788882d4ab]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d83a9f-4de3-4e4d-8418-9ba69ac832f0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9037c7c-11db-432b-a988-438d115c22db]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cffc20-6d27-408c-b222-1850bbb9929f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1b8089-8e63-40bd-ba78-eb0379c5e717]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260]
Jul 25 16:49:21 user nova-compute[70659]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:21 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4631a1ff-4cfe-4c1f-8958-8232a8ca6c29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d804753f-1d49-44fd-9748-f51b00184667]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] <== disconnect_volume: return (298ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:49:21 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:49:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:22 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Deleted allocations for instance 0801e7d7-36b9-4e3d-919d-0728ae2e2c29
Jul 25 16:49:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7346e00e-3031-4972-bb32-fe20a58ea929 tempest-TaggedBootDevicesTest_v242-858302614 tempest-TaggedBootDevicesTest_v242-858302614-project-member] Lock "0801e7d7-36b9-4e3d-919d-0728ae2e2c29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.328s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:22 user nova-compute[70659]: DEBUG nova.objects.instance [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lazy-loading 'flavor' on Instance uuid 98c0757f-7146-48ea-ac36-e7c107e74d73 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-665dcb56-705c-4c47-a6f7-3d7cd79c6fc7 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.804s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303751.1985257, 0801e7d7-36b9-4e3d-919d-0728ae2e2c29 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:49:26 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] VM Stopped (Lifecycle Event)
Jul 25 16:49:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-a2fe0cb9-82d9-478a-a26e-13df5e32a88e None None] [instance: 0801e7d7-36b9-4e3d-919d-0728ae2e2c29] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:26 user nova-compute[70659]: INFO nova.compute.manager [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Terminating instance
Jul 25 16:49:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-4ecee758-1eec-40ef-82ed-716876238b7e req-633958f7-41fe-4736-84ce-d0051186e431 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-unplugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4ecee758-1eec-40ef-82ed-716876238b7e req-633958f7-41fe-4736-84ce-d0051186e431 service nova] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4ecee758-1eec-40ef-82ed-716876238b7e req-633958f7-41fe-4736-84ce-d0051186e431 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4ecee758-1eec-40ef-82ed-716876238b7e req-633958f7-41fe-4736-84ce-d0051186e431 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-4ecee758-1eec-40ef-82ed-716876238b7e req-633958f7-41fe-4736-84ce-d0051186e431 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] No waiting events found dispatching network-vif-unplugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-4ecee758-1eec-40ef-82ed-716876238b7e req-633958f7-41fe-4736-84ce-d0051186e431 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-unplugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:27 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Instance destroyed successfully.
Jul 25 16:49:27 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lazy-loading 'resources' on Instance uuid d437efde-81a8-4be0-b9f8-7a34ee7fea3b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T16:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1506231380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1506231380',id=8,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASmEG7RFCQFi+1G28n7yNAKzcoCuwcnKcQdXmSbHnxoTEkTop7z5XfU9a4Z/QnRF+riya1mdEECpaqnVJkE7ons8sjRqycUy7lP2+85LLnF913u1TMT3K9a21H+JzyCuw==',key_name='tempest-keypair-1108947464',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c6ebfc7cdb0435287b8e82062151463',ramdisk_id='',reservation_id='r-natyacfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1788409359',owner_user_name='tempest-TaggedAttachmentsTest-1788409359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3c840bf6c1a438bb2e28e2582e6d7fa',uuid=d437efde-81a8-4be0-b9f8-7a34ee7fea3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converting VIF {"id": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "address": "fa:16:3e:75:35:58", "network": {"id": "a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1854443373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6ebfc7cdb0435287b8e82062151463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b9f6ed-8f", "ovs_interfaceid": "22b9f6ed-8f52-4a52-84e9-098f874d5682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:35:58,bridge_name='br-int',has_traffic_filtering=True,id=22b9f6ed-8f52-4a52-84e9-098f874d5682,network=Network(a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b9f6ed-8f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG os_vif [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:35:58,bridge_name='br-int',has_traffic_filtering=True,id=22b9f6ed-8f52-4a52-84e9-098f874d5682,network=Network(a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b9f6ed-8f') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22b9f6ed-8f, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:27 user nova-compute[70659]: INFO os_vif [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:35:58,bridge_name='br-int',has_traffic_filtering=True,id=22b9f6ed-8f52-4a52-84e9-098f874d5682,network=Network(a2d2f3ab-16e4-4524-bbfc-b3639e8b5b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b9f6ed-8f')
Jul 25 16:49:27 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Deleting instance files /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b_del
Jul 25 16:49:27 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Deletion of /opt/stack/data/nova/instances/d437efde-81a8-4be0-b9f8-7a34ee7fea3b_del complete
Jul 25 16:49:27 user nova-compute[70659]: INFO nova.compute.manager [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 25 16:49:27 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:49:27 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:49:28 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:28 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Took 1.22 seconds to deallocate network for instance.
Jul 25 16:49:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-bc48f89f-a791-4f36-9aa4-0326c629c6cc req-29887749-bbdf-49ee-8914-1b73a8d65dd9 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-deleted-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-d3e53b36-1553-4746-bd0b-4b2a2428bee9 req-6196ca66-65f4-40a0-b88c-96ad4f959de7 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received event network-vif-plugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d3e53b36-1553-4746-bd0b-4b2a2428bee9 req-6196ca66-65f4-40a0-b88c-96ad4f959de7 service nova] Acquiring lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d3e53b36-1553-4746-bd0b-4b2a2428bee9 req-6196ca66-65f4-40a0-b88c-96ad4f959de7 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d3e53b36-1553-4746-bd0b-4b2a2428bee9 req-6196ca66-65f4-40a0-b88c-96ad4f959de7 service nova] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-d3e53b36-1553-4746-bd0b-4b2a2428bee9 req-6196ca66-65f4-40a0-b88c-96ad4f959de7 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] No waiting events found dispatching network-vif-plugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:29 user nova-compute[70659]: WARNING nova.compute.manager [req-d3e53b36-1553-4746-bd0b-4b2a2428bee9 req-6196ca66-65f4-40a0-b88c-96ad4f959de7 service nova] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Received unexpected event network-vif-plugged-22b9f6ed-8f52-4a52-84e9-098f874d5682 for instance with vm_state deleted and task_state None.
Jul 25 16:49:29 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:49:29 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:49:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:29 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Deleted allocations for instance d437efde-81a8-4be0-b9f8-7a34ee7fea3b
Jul 25 16:49:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d5db8643-337b-42c5-bd34-86814aa88a05 tempest-TaggedAttachmentsTest-1788409359 tempest-TaggedAttachmentsTest-1788409359-project-member] Lock "d437efde-81a8-4be0-b9f8-7a34ee7fea3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.859s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:42 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303767.488003, d437efde-81a8-4be0-b9f8-7a34ee7fea3b => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:49:42 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] VM Stopped (Lifecycle Event)
Jul 25 16:49:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9d7ab271-446c-436b-a8c8-aeb930edcf41 None None] [instance: d437efde-81a8-4be0-b9f8-7a34ee7fea3b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:49:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:49:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:49:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:49:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:45 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:49:45 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7919MB free_disk=25.610641479492188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c9728d00-f454-4616-af0b-8cfd0f012cad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 98c0757f-7146-48ea-ac36-e7c107e74d73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 6f6117f9-a000-4491-bd38-b7525298c23a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:49:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:49:46 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:49:46 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:49:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:49:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Updating instance_info_cache with network_info: [{"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-c9728d00-f454-4616-af0b-8cfd0f012cad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:49:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'flavor' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:49 user nova-compute[70659]: INFO nova.compute.manager [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Attaching volume a42f574e-bafc-4e90-9fc2-f92970561add to /dev/vdb
Jul 25 16:49:49 user nova-compute[70659]: DEBUG os_brick.utils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a988c69f-f772-45de-b548-71b3316db40f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3f492a-affe-4fe2-b745-bf6cadab8f12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc163a45-66c9-4987-8115-e5711e8de807]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661c2b7-3696-4caf-9244-de576e4ee968]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:49:49 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:49:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5cc29b-297e-4ad6-a3ce-741c1b837008]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG os_brick.utils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:49 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating existing volume attachment record: bbcab0bd-a725-4009-8635-0b4bfe30e873 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:49:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:53 user nova-compute[70659]: DEBUG nova.compute.manager [req-054c3cf4-56dc-488b-814d-c862021d3309 req-ea01c01e-0f84-498a-83f5-f1246389cf61 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-changed-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:53 user nova-compute[70659]: DEBUG nova.compute.manager [req-054c3cf4-56dc-488b-814d-c862021d3309 req-ea01c01e-0f84-498a-83f5-f1246389cf61 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Refreshing instance network info cache due to event network-changed-31647377-15e8-4c48-a3f9-0601ae9b7493. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:49:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-054c3cf4-56dc-488b-814d-c862021d3309 req-ea01c01e-0f84-498a-83f5-f1246389cf61 service nova] Acquiring lock "refresh_cache-6f6117f9-a000-4491-bd38-b7525298c23a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:49:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-054c3cf4-56dc-488b-814d-c862021d3309 req-ea01c01e-0f84-498a-83f5-f1246389cf61 service nova] Acquired lock "refresh_cache-6f6117f9-a000-4491-bd38-b7525298c23a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:49:53 user nova-compute[70659]: DEBUG nova.network.neutron [req-054c3cf4-56dc-488b-814d-c862021d3309 req-ea01c01e-0f84-498a-83f5-f1246389cf61 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Refreshing network info cache for port 31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.network.neutron [req-054c3cf4-56dc-488b-814d-c862021d3309 req-ea01c01e-0f84-498a-83f5-f1246389cf61 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Updated VIF entry in instance network info cache for port 31647377-15e8-4c48-a3f9-0601ae9b7493. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.network.neutron [req-054c3cf4-56dc-488b-814d-c862021d3309 req-ea01c01e-0f84-498a-83f5-f1246389cf61 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Updating instance_info_cache with network_info: [{"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-054c3cf4-56dc-488b-814d-c862021d3309 req-ea01c01e-0f84-498a-83f5-f1246389cf61 service nova] Releasing lock "refresh_cache-6f6117f9-a000-4491-bd38-b7525298c23a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:54 user nova-compute[70659]: INFO nova.compute.manager [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Unshelving
Jul 25 16:49:54 user nova-compute[70659]: INFO nova.virt.block_device [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Booting with volume 0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae at /dev/vdc
Jul 25 16:49:54 user nova-compute[70659]: DEBUG os_brick.utils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a6f25a-8196-4378-8a20-ea7b1daed083]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45de14f-c0c4-4943-a19a-a002205da830]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:54 user nova-compute[70659]: INFO nova.compute.manager [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Rebuilding instance
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[268d2c6e-0d7d-44db-bbf4-56c3027c19f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeea771-8770-4908-800b-70cbb8d0e87a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:49:54 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:49:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27e3db5-8b28-47b4-9810-67bdf5b1e4e4]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG os_brick.utils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating existing volume attachment record: 96e71a51-5ca9-48a7-868c-71d29dd9a846 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f6117f9-a000-4491-bd38-b7525298c23a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'pci_requests' on Instance uuid 6f6117f9-a000-4491-bd38-b7525298c23a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f6117f9-a000-4491-bd38-b7525298c23a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'resources' on Instance uuid 6f6117f9-a000-4491-bd38-b7525298c23a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'migration_context' on Instance uuid 6f6117f9-a000-4491-bd38-b7525298c23a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70659) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-3896494e-6899-4564-b100-3ae6dcc451f8 req-f6eac1f4-0ef0-4d0f-ac3a-66d675bedc9f service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-unplugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3896494e-6899-4564-b100-3ae6dcc451f8 req-f6eac1f4-0ef0-4d0f-ac3a-66d675bedc9f service nova] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3896494e-6899-4564-b100-3ae6dcc451f8 req-f6eac1f4-0ef0-4d0f-ac3a-66d675bedc9f service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3896494e-6899-4564-b100-3ae6dcc451f8 req-f6eac1f4-0ef0-4d0f-ac3a-66d675bedc9f service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-3896494e-6899-4564-b100-3ae6dcc451f8 req-f6eac1f4-0ef0-4d0f-ac3a-66d675bedc9f service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] No waiting events found dispatching network-vif-unplugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:55 user nova-compute[70659]: WARNING nova.compute.manager [req-3896494e-6899-4564-b100-3ae6dcc451f8 req-f6eac1f4-0ef0-4d0f-ac3a-66d675bedc9f service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received unexpected event network-vif-unplugged-31647377-15e8-4c48-a3f9-0601ae9b7493 for instance with vm_state active and task_state rebuilding.
Jul 25 16:49:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance destroyed successfully.
Jul 25 16:49:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance destroyed successfully.
Jul 25 16:49:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1867016362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1510861238',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdrrnEIsPtiOyPXZwZDkWWdRWRmg5eRltyImohYN5f/QNID4CDxf10xSW043jjUbCODnxMzL1McqL4p/4z9m7F1bT8oACH9CMyevg1NsoxnXEziUsCowS7fJm1RWMTB9A==',key_name='tempest-keypair-1581675553',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:48:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fa87ca828941408ebb81eb439ebbc79e',ramdisk_id='',reservation_id='r-66ri7r0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510925623',owner_user_name='tempest-ServerActionsV293TestJSON-510925623-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad466988c34f4e06b5c631b9754db2c5',uuid=6f6117f9-a000-4491-bd38-b7525298c23a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converting VIF {"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_vif [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31647377-15, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:55 user nova-compute[70659]: INFO os_vif [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15')
Jul 25 16:49:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFZiMvGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:55 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9de5ba-950b-4826-9fa8-1c761c6260d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b33bcb-9a33-46ad-ab8b-605d88f0e642]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:55 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:55 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:49:55 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:55 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd31565900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252'): ({'sdi'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Removing single pathed devices sdi {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[02091b04-b77d-4ffa-a5e9-84eaf7eda78d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b408a8-d3eb-4d27-a8c2-5ce33604f730]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Flushing IO for device /dev/sdi {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0df1c59-501b-4f96-881b-fbd43cbeb13c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[15775397-a6b4-407f-a446-b6de53705ede]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] SCSI volumes sdi have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5898e0-6de4-4794-affb-c68df0e8b1d0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52726d8-dfaa-4b1f-b934-7cf4d084dedc]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260]
Jul 25 16:49:55 user nova-compute[70659]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:55 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1c95d5-bd0b-4232-bd1b-f45846f2dea7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] <== disconnect_volume: return (296ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Deleting instance files /opt/stack/data/nova/instances/6f6117f9-a000-4491-bd38-b7525298c23a_del
Jul 25 16:49:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Deletion of /opt/stack/data/nova/instances/6f6117f9-a000-4491-bd38-b7525298c23a_del complete
Jul 25 16:49:56 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 6f6117f9-a000-4491-bd38-b7525298c23a could not be found.
Jul 25 16:49:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFZiMvGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:56 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb6c2a-20ae-46e0-8a81-d9abba03582a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3bc7a8-0358-4e8d-890d-036cd2c7e9b7]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:56 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:56 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30366cb0>, {}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Disconnecting from: [] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.044s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] <== disconnect_volume: return (44ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:49:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-2130de98-ddd1-4c24-a1ec-115bb5766a9d req-d68a4878-7e3c-4819-b19d-6d8a061e0f5c service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2130de98-ddd1-4c24-a1ec-115bb5766a9d req-d68a4878-7e3c-4819-b19d-6d8a061e0f5c service nova] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2130de98-ddd1-4c24-a1ec-115bb5766a9d req-d68a4878-7e3c-4819-b19d-6d8a061e0f5c service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2130de98-ddd1-4c24-a1ec-115bb5766a9d req-d68a4878-7e3c-4819-b19d-6d8a061e0f5c service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-2130de98-ddd1-4c24-a1ec-115bb5766a9d req-d68a4878-7e3c-4819-b19d-6d8a061e0f5c service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] No waiting events found dispatching network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:49:57 user nova-compute[70659]: WARNING nova.compute.manager [req-2130de98-ddd1-4c24-a1ec-115bb5766a9d req-d68a4878-7e3c-4819-b19d-6d8a061e0f5c service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received unexpected event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 for instance with vm_state active and task_state rebuilding.
Jul 25 16:49:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:49:57 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:57 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:49:57 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Preparing to wait for external event volume-reimaged-b5c8d082-5cb7-44e9-b086-4de249762252 {{(pid=70659) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[145e258a-6bad-4ae8-a96c-096d96e1df22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:49:57 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[408eed44-9f3a-448b-8252-f8f5711b03ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add] added
Jul 25 16:49:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fcf70e-563e-4244-95a2-94de11e5e163]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5890122-d973-4ced-b97f-3b395a4ea64b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgFjEUbd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgFjEUbd" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded74c42-3c77-4fd6-ae33-92e74bbcff8c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgFjEUbd'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b64b6f-0ecf-4c86-b71f-e07f95a65513]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff8eed9-1ce8-4053-9ef9-3ce0a765ac30]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe34917-0ce7-4284-bf0c-faf6406474b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]
Jul 25 16:49:57 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.
Jul 25 16:49:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[26600685-8401-42ca-bbf4-506f25a36e9c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec35565a-2e22-4045-92b6-3543286207bf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:49:57 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:49:57 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:49:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff21fc5-de7f-42cd-becd-fc0d11bdf2d9]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:49:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:49:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:49:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23866653066636166', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:49:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866653066636166', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:49:58 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'flavor' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:49:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:49:58 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:49:58 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:49:58 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:49:58 user nova-compute[70659]:   <serial>a42f574e-bafc-4e90-9fc2-f92970561add</serial>
Jul 25 16:49:58 user nova-compute[70659]: </disk>
Jul 25 16:49:58 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:49:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:49:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:49:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] No VIF found with MAC fa:16:3e:3b:ca:b5, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:49:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b247906d-1ff0-4b86-b3e2-c6587b6bbda5 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.455s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Stashing vm_state: active {{(pid=70659) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 25 16:50:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:01 user nova-compute[70659]: DEBUG nova.objects.instance [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'pci_requests' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:50:01 user nova-compute[70659]: INFO nova.compute.claims [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Claim successful on node user
Jul 25 16:50:01 user nova-compute[70659]: DEBUG nova.objects.instance [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'resources' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:01 user nova-compute[70659]: DEBUG nova.objects.instance [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'pci_devices' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:01 user nova-compute[70659]: INFO nova.compute.resource_tracker [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating resource usage from migration 882997f6-8615-4f80-a72b-4f8c33f47863
Jul 25 16:50:02 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.481s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:02 user nova-compute[70659]: INFO nova.compute.manager [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Migrating
Jul 25 16:50:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:50:02 user nova-compute[70659]: INFO nova.compute.rpcapi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 25 16:50:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquired lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG nova.network.neutron [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG nova.network.neutron [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance_info_cache with network_info: [{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Releasing lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Starting migrate_disk_and_power_off {{(pid=70659) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-5612b75f-465c-4f0f-a7e9-4ce6027551ec req-79feec4c-42aa-4f34-b2e6-9ecf9ea3184b service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-unplugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5612b75f-465c-4f0f-a7e9-4ce6027551ec req-79feec4c-42aa-4f34-b2e6-9ecf9ea3184b service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5612b75f-465c-4f0f-a7e9-4ce6027551ec req-79feec4c-42aa-4f34-b2e6-9ecf9ea3184b service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5612b75f-465c-4f0f-a7e9-4ce6027551ec req-79feec4c-42aa-4f34-b2e6-9ecf9ea3184b service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-5612b75f-465c-4f0f-a7e9-4ce6027551ec req-79feec4c-42aa-4f34-b2e6-9ecf9ea3184b service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-unplugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:03 user nova-compute[70659]: WARNING nova.compute.manager [req-5612b75f-465c-4f0f-a7e9-4ce6027551ec req-79feec4c-42aa-4f34-b2e6-9ecf9ea3184b service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-unplugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state active and task_state resize_migrating.
Jul 25 16:50:03 user nova-compute[70659]: DEBUG nova.objects.instance [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquired lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:50:03 user nova-compute[70659]: DEBUG nova.objects.instance [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'info_cache' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance destroyed successfully.
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1071496954',display_name='tempest-ServerActionsTestOtherB-server-1071496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1071496954',id=7,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWJlFb4j8Ys1CPB/bDiS40Ugcuw2Q/xoj3AvPfDyBBFFTZke2FjMd2/DfM6CM24MZfC34jM3nOUoDm3L0rcAn9FD/4h8gEUHn4G9Y2qb8q+bjHLww9szHUFjYPz7u30g==',key_name='tempest-keypair-329454245',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb25024c830544d682f76d9dc10171e2',ramdisk_id='',reservation_id='r-y1z79cx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1921270631',owner_user_name='tempest-ServerActionsTestOtherB-1921270631-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:50:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ebfb3f4c65f4e16be5234a8a4e99e3c',uuid=5192b767-96f0-4789-ac74-0d6d6b5bef3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-863559494-network", "vif_mac": "fa:16:3e:3b:ca:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converting VIF {"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-863559494-network", "vif_mac": "fa:16:3e:3b:ca:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_vif [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f746e90-8b, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:04 user nova-compute[70659]: INFO os_vif [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b')
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:50:04 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updating instance_info_cache with network_info: [{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7d98f7-5f76-4df1-958f-11e3f51d9c29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Releasing lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fb5f29-2f81-452b-98cd-7393e7fd46e5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:50:04 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:04 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:50:04 user nova-compute[70659]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:04 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd3049be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acd046e-5ba1-4ddc-8e50-05049c0c0c39]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance destroyed successfully.
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'resources' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252348890',display_name='tempest-AttachVolumeTestJSON-server-1252348890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252348890',id=5,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl7hEIoOzploaaVJzvHH8s9XWd3DqHJQDS4RGFYYAnouMce0kg5Qq6bJLKJ1xPuEcKILYqVCIIw7SRQhcjnOOD1emebVM/xSSTVD/YqNbIqjFDTdfW8AR1dAleT+Ed0Qw==',key_name='tempest-keypair-1208202396',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-dwrzw3y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=9df22b5f-c0e3-4eb5-9054-c593d0660ee5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_vif [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710df66-cb81-48e1-b714-fc1e6b233635]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c7f2734-73, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:50:04 user nova-compute[70659]: INFO os_vif [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73')
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'pci_requests' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5415e1-5b5f-4e0b-b120-1f5a11507597]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gizvkWxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:50:04 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'numa_topology' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:50:04 user nova-compute[70659]: INFO nova.compute.claims [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Claim successful on node user
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31da010f-76b2-4e1d-a753-dc248465954e]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b033a4df-6c8d-42e1-a5d9-32abea1a2c64]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dcbd50-4524-49f8-a92a-246cbd79003b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]
Jul 25 16:50:04 user nova-compute[70659]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.
Jul 25 16:50:04 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7e48bc-2432-43b1-a0b3-a342bf188c4d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] <== disconnect_volume: return (302ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.170s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d987dd-3b3b-4682-bab0-b52bcf7734a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[052e486e-2ddb-43bc-b72a-d9536d187099]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:04 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:04 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30585c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d'): ({'sdh'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Removing single pathed devices sdh {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4bf617-65e1-4b16-a03c-ae27a1932d65]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ec462b-5a94-4321-be8b-fc33b72f8029]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flushing IO for device /dev/sdh {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fdbd06-8c68-4433-9f66-ad9f3ce2cfed]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[22273f3d-9e5b-4c68-9849-2613e35d15f5]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] SCSI volumes sdh have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33419b9-f0ae-45e7-b7ca-6d6d742b4bd0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fddab1-7887-4799-9ea7-56538a875fc2]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260]
Jul 25 16:50:04 user nova-compute[70659]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260] successful.
Jul 25 16:50:04 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e_resize/disk /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ba0f95-b18b-4652-a858-2cef88412405]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== disconnect_volume: return (540ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Start _get_guest_xml network_info=[{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e7bd593b-a842-498e-ba84-a4221c2b6206', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gizvkWxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '9df22b5f-c0e3-4eb5-9054-c593d0660ee5', 'attached_at': '', 'detached_at': '', 'volume_id': '142da0f9-710e-45ac-aef3-6ca961bb6c6d', 'serial': '142da0f9-710e-45ac-aef3-6ca961bb6c6d'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'numa_topology' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:04 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:04 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gizvkWxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:50:04 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:04 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:04 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:50:04 user nova-compute[70659]: INFO nova.network.neutron [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating port 219a0a7f-2318-4e5c-b5da-9f9bf813174a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5720250c-2919-4509-88cb-4ea338f5990a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:50:04 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[59350fc8-4dcb-4d8c-85e5-a6da02b2f7ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d] added
Jul 25 16:50:04 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b284e5bc-0966-4bd7-baf4-0072c8bf4858]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32128d2-86bc-4e8f-a68e-124faf6246fb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gizvkWxB {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gizvkWxB" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c9e5e8-ec4b-4479-887d-4353d21a127b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gizvkWxB'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a36a59-ac23-42d1-856d-12dc7222202f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6a8253-3992-4a9d-9827-56378e1eba5c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:50:05 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:50:05 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:05 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 16:50:05 user nova-compute[70659]: 
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc5b905-bae2-496c-89d9-246b92487430]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260]
Jul 25 16:50:05 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260] successful.
Jul 25 16:50:05 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f56492-2dd7-4f83-9473-ce0e0c9cc0e6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[47207c05-19bb-43bf-888d-81384b32c312]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:05 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:05 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "cp -r /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e_resize/disk /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk" returned: 0 in 0.474s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e_resize/disk.info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk.info {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4060297-2f1d-4b3d-a5b7-948800df07e3]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "cp -r /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e_resize/disk.info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk.info" returned: 0 in 0.047s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gizvkWxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-de9e9334-4bb9-412e-8254-1e804001c18e req-b4f81c3a-999a-4a8e-86b3-8dfd1700f75a service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-de9e9334-4bb9-412e-8254-1e804001c18e req-b4f81c3a-999a-4a8e-86b3-8dfd1700f75a service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-de9e9334-4bb9-412e-8254-1e804001c18e req-b4f81c3a-999a-4a8e-86b3-8dfd1700f75a service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-de9e9334-4bb9-412e-8254-1e804001c18e req-b4f81c3a-999a-4a8e-86b3-8dfd1700f75a service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-de9e9334-4bb9-412e-8254-1e804001c18e req-b4f81c3a-999a-4a8e-86b3-8dfd1700f75a service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:05 user nova-compute[70659]: WARNING nova.compute.manager [req-de9e9334-4bb9-412e-8254-1e804001c18e req-b4f81c3a-999a-4a8e-86b3-8dfd1700f75a service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state active and task_state resize_migrating.
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquired lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-958ecc21-1226-463e-a848-2fb5cbc06527 req-cbb2cb74-8c6c-45da-b6ef-1492408f519b service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-changed-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-958ecc21-1226-463e-a848-2fb5cbc06527 req-cbb2cb74-8c6c-45da-b6ef-1492408f519b service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Refreshing instance network info cache due to event network-changed-219a0a7f-2318-4e5c-b5da-9f9bf813174a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:50:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-958ecc21-1226-463e-a848-2fb5cbc06527 req-cbb2cb74-8c6c-45da-b6ef-1492408f519b service nova] Acquiring lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating instance_info_cache with network_info: [{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Releasing lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:50:06 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Creating image(s)
Jul 25 16:50:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-958ecc21-1226-463e-a848-2fb5cbc06527 req-cbb2cb74-8c6c-45da-b6ef-1492408f519b service nova] Acquired lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-958ecc21-1226-463e-a848-2fb5cbc06527 req-cbb2cb74-8c6c-45da-b6ef-1492408f519b service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Refreshing network info cache for port 219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23666633534643737', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:50:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666633534643737', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252348890',display_name='tempest-AttachVolumeTestJSON-server-1252348890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252348890',id=5,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl7hEIoOzploaaVJzvHH8s9XWd3DqHJQDS4RGFYYAnouMce0kg5Qq6bJLKJ1xPuEcKILYqVCIIw7SRQhcjnOOD1emebVM/xSSTVD/YqNbIqjFDTdfW8AR1dAleT+Ed0Qw==',key_name='tempest-keypair-1208202396',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-dwrzw3y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=9df22b5f-c0e3-4eb5-9054-c593d0660ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.objects.instance [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'pci_devices' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:50:07 user nova-compute[70659]:   <uuid>9df22b5f-c0e3-4eb5-9054-c593d0660ee5</uuid>
Jul 25 16:50:07 user nova-compute[70659]:   <name>instance-00000005</name>
Jul 25 16:50:07 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:50:07 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:50:07 user nova-compute[70659]:   <metadata>
Jul 25 16:50:07 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:50:07 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:50:07 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeTestJSON-server-1252348890</nova:name>
Jul 25 16:50:07 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:50:04</nova:creationTime>
Jul 25 16:50:07 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:50:07 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:50:07 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:50:07 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:50:07 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:50:07 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:50:07 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:50:07 user nova-compute[70659]:       <nova:owner>
Jul 25 16:50:07 user nova-compute[70659]:         <nova:user uuid="a77a77d2b1954c10ace66ba38fd9ff6c">tempest-AttachVolumeTestJSON-212658614-project-member</nova:user>
Jul 25 16:50:07 user nova-compute[70659]:         <nova:project uuid="07de6ba95db444b5b10d51ef16525948">tempest-AttachVolumeTestJSON-212658614</nova:project>
Jul 25 16:50:07 user nova-compute[70659]:       </nova:owner>
Jul 25 16:50:07 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:50:07 user nova-compute[70659]:       <nova:ports>
Jul 25 16:50:07 user nova-compute[70659]:         <nova:port uuid="3c7f2734-73c4-4648-a080-0ea25238dad8">
Jul 25 16:50:07 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 16:50:07 user nova-compute[70659]:         </nova:port>
Jul 25 16:50:07 user nova-compute[70659]:       </nova:ports>
Jul 25 16:50:07 user nova-compute[70659]:     </nova:instance>
Jul 25 16:50:07 user nova-compute[70659]:   </metadata>
Jul 25 16:50:07 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:50:07 user nova-compute[70659]:     <system>
Jul 25 16:50:07 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:50:07 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:50:07 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:50:07 user nova-compute[70659]:       <entry name="serial">9df22b5f-c0e3-4eb5-9054-c593d0660ee5</entry>
Jul 25 16:50:07 user nova-compute[70659]:       <entry name="uuid">9df22b5f-c0e3-4eb5-9054-c593d0660ee5</entry>
Jul 25 16:50:07 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:50:07 user nova-compute[70659]:     </system>
Jul 25 16:50:07 user nova-compute[70659]:   </sysinfo>
Jul 25 16:50:07 user nova-compute[70659]:   <os>
Jul 25 16:50:07 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:50:07 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:50:07 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:50:07 user nova-compute[70659]:   </os>
Jul 25 16:50:07 user nova-compute[70659]:   <features>
Jul 25 16:50:07 user nova-compute[70659]:     <acpi/>
Jul 25 16:50:07 user nova-compute[70659]:     <apic/>
Jul 25 16:50:07 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:50:07 user nova-compute[70659]:   </features>
Jul 25 16:50:07 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:50:07 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:50:07 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:50:07 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:50:07 user nova-compute[70659]:   </clock>
Jul 25 16:50:07 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:50:07 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:50:07 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:50:07 user nova-compute[70659]:   </cpu>
Jul 25 16:50:07 user nova-compute[70659]:   <devices>
Jul 25 16:50:07 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:50:07 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:50:07 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk"/>
Jul 25 16:50:07 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:50:07 user nova-compute[70659]:     </disk>
Jul 25 16:50:07 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:50:07 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:50:07 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 16:50:07 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 16:50:07 user nova-compute[70659]:       <serial>142da0f9-710e-45ac-aef3-6ca961bb6c6d</serial>
Jul 25 16:50:07 user nova-compute[70659]:     </disk>
Jul 25 16:50:07 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:50:07 user nova-compute[70659]:       <mac address="fa:16:3e:ea:f3:27"/>
Jul 25 16:50:07 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:07 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:50:07 user nova-compute[70659]:       <target dev="tap3c7f2734-73"/>
Jul 25 16:50:07 user nova-compute[70659]:     </interface>
Jul 25 16:50:07 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:50:07 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/console.log" append="off"/>
Jul 25 16:50:07 user nova-compute[70659]:     </serial>
Jul 25 16:50:07 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:50:07 user nova-compute[70659]:     <video>
Jul 25 16:50:07 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:07 user nova-compute[70659]:     </video>
Jul 25 16:50:07 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:50:07 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:50:07 user nova-compute[70659]:     </rng>
Jul 25 16:50:07 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:50:07 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:50:07 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:50:07 user nova-compute[70659]:     </memballoon>
Jul 25 16:50:07 user nova-compute[70659]:   </devices>
Jul 25 16:50:07 user nova-compute[70659]: </domain>
Jul 25 16:50:07 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb.part --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.virt.images [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] ba71fd72-cd33-4493-b536-539dc1f80bac was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb.part /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.objects.instance [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb.part /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb.converted" returned: 0 in 0.380s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.network.neutron [req-958ecc21-1226-463e-a848-2fb5cbc06527 req-cbb2cb74-8c6c-45da-b6ef-1492408f519b service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updated VIF entry in instance network info cache for port 219a0a7f-2318-4e5c-b5da-9f9bf813174a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.network.neutron [req-958ecc21-1226-463e-a848-2fb5cbc06527 req-cbb2cb74-8c6c-45da-b6ef-1492408f519b service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating instance_info_cache with network_info: [{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-958ecc21-1226-463e-a848-2fb5cbc06527 req-cbb2cb74-8c6c-45da-b6ef-1492408f519b service nova] Releasing lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.630s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Cannot resize image /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.objects.instance [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'migration_context' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252348890',display_name='tempest-AttachVolumeTestJSON-server-1252348890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252348890',id=5,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl7hEIoOzploaaVJzvHH8s9XWd3DqHJQDS4RGFYYAnouMce0kg5Qq6bJLKJ1xPuEcKILYqVCIIw7SRQhcjnOOD1emebVM/xSSTVD/YqNbIqjFDTdfW8AR1dAleT+Ed0Qw==',key_name='tempest-keypair-1208202396',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-dwrzw3y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=9df22b5f-c0e3-4eb5-9054-c593d0660ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG os_vif [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c7f2734-73, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c7f2734-73, col_values=(('external_ids', {'iface-id': '3c7f2734-73c4-4648-a080-0ea25238dad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:f3:27', 'vm-uuid': '9df22b5f-c0e3-4eb5-9054-c593d0660ee5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:07 user nova-compute[70659]: INFO os_vif [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73')
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb --force-share --output=json" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb,backing_fmt=raw /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb,backing_fmt=raw /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk 1073741824" returned: 0 in 0.051s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'migration_context' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Port 8f746e90-8b94-4b8c-8c13-02df5983ced0 binding to destination host user is already ACTIVE {{(pid=70659) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 25 16:50:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Rebasing disk image.
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.157s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 -F raw /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquired lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:50:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance_info_cache with network_info: [{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Releasing lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG os_brick.utils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ca79cf-2be7-4519-9b37-4d13ba77d796]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3b231b-314b-4073-8ce4-dc6bb868672e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0c720c-55ea-4e5d-b6de-39ec53f01491]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb88748-7a0a-473a-932a-5124cf1cfad5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:50:09 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7fd727-43c0-4d4d-83d1-cf8cd72465b8]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG os_brick.utils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-9247215f-7311-481e-a431-8ebf7ffbeddc req-5fc01219-e520-4e8c-8dd7-f7d5aef96a82 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9247215f-7311-481e-a431-8ebf7ffbeddc req-5fc01219-e520-4e8c-8dd7-f7d5aef96a82 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9247215f-7311-481e-a431-8ebf7ffbeddc req-5fc01219-e520-4e8c-8dd7-f7d5aef96a82 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9247215f-7311-481e-a431-8ebf7ffbeddc req-5fc01219-e520-4e8c-8dd7-f7d5aef96a82 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-9247215f-7311-481e-a431-8ebf7ffbeddc req-5fc01219-e520-4e8c-8dd7-f7d5aef96a82 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:09 user nova-compute[70659]: WARNING nova.compute.manager [req-9247215f-7311-481e-a431-8ebf7ffbeddc req-5fc01219-e520-4e8c-8dd7-f7d5aef96a82 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state stopped and task_state powering-on.
Jul 25 16:50:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:10 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303795.4507272, 6f6117f9-a000-4491-bd38-b7525298c23a => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:10 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] VM Stopped (Lifecycle Event)
Jul 25 16:50:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e219f495-8205-4f31-9dfd-8027682cffb2 None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 -F raw /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk" returned: 0 in 2.439s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:50:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Ensure instance console log exists: /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:50:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Start _get_guest_xml network_info=[{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c3498dd87e2edbbecc2cec31a2ebbd73',container_format='bare',created_at=2023-07-25T16:48:01Z,direct_url=<?>,disk_format='qcow2',id=ba71fd72-cd33-4493-b536-539dc1f80bac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-905791245-shelved',owner='6b9ac672b01748d191239756a58474c3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T16:48:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '96e71a51-5ca9-48a7-868c-71d29dd9a846', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWvmOoFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a', 'attached_at': '', 'detached_at': '', 'volume_id': '0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae', 'serial': '0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:50:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c3498dd87e2edbbecc2cec31a2ebbd73',container_format='bare',created_at=2023-07-25T16:48:01Z,direct_url=<?>,disk_format='qcow2',id=ba71fd72-cd33-4493-b536-539dc1f80bac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-905791245-shelved',owner='6b9ac672b01748d191239756a58474c3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T16:48:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWvmOoFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:50:11 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:11 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:11 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f8304-492f-47a5-ba81-1f91b9a84195]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:50:11 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19c47cb-6d30-427c-8013-e1e92fb2a907]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae] added
Jul 25 16:50:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.055s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f82c74-f303-4b75-b495-041d42d69343]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.099s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c5c08f-6b93-4f48-8c5f-7d1445118b7c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AWvmOoFM {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AWvmOoFM" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e493f9ba-79b5-4880-b490-db3b572f957d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AWvmOoFM'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.067s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f1922e-2c53-40a0-9fc7-6ed1bad36e90]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a1adc-0cfc-489c-97d2-0bcdd7f232a1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:11 user nova-compute[70659]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:50:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:11 user nova-compute[70659]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:50:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5877614b-7139-410b-925a-add4abf392ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae, portal: 172.16.0.220,3260]
Jul 25 16:50:11 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae, portal: 172.16.0.220,3260] successful.
Jul 25 16:50:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:11 user nova-compute[70659]: INFO nova.compute.manager [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Terminating instance
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[349a6eda-a417-4893-9e43-1c4b07a408e7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ed6b03-0ea8-444a-b0f4-3de090031221]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:11 user nova-compute[70659]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:50:11 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:11 user nova-compute[70659]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:50:11 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.462s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb05fb1-049d-4561-bd9d-e192c77a7d36]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWvmOoFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-52bf9428-ac9b-424e-bf25-bc278a27f5c6 req-332de58f-c980-4e97-a931-17f93361224d service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received event network-vif-unplugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-52bf9428-ac9b-424e-bf25-bc278a27f5c6 req-332de58f-c980-4e97-a931-17f93361224d service nova] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-52bf9428-ac9b-424e-bf25-bc278a27f5c6 req-332de58f-c980-4e97-a931-17f93361224d service nova] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-52bf9428-ac9b-424e-bf25-bc278a27f5c6 req-332de58f-c980-4e97-a931-17f93361224d service nova] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-52bf9428-ac9b-424e-bf25-bc278a27f5c6 req-332de58f-c980-4e97-a931-17f93361224d service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] No waiting events found dispatching network-vif-unplugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-52bf9428-ac9b-424e-bf25-bc278a27f5c6 req-332de58f-c980-4e97-a931-17f93361224d service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received event network-vif-unplugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-0e1c3105-c25b-4fca-872f-3c8fd6b682d7 req-956ac7c3-b77a-46e3-92a4-bf19563d1352 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0e1c3105-c25b-4fca-872f-3c8fd6b682d7 req-956ac7c3-b77a-46e3-92a4-bf19563d1352 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0e1c3105-c25b-4fca-872f-3c8fd6b682d7 req-956ac7c3-b77a-46e3-92a4-bf19563d1352 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0e1c3105-c25b-4fca-872f-3c8fd6b682d7 req-956ac7c3-b77a-46e3-92a4-bf19563d1352 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-0e1c3105-c25b-4fca-872f-3c8fd6b682d7 req-956ac7c3-b77a-46e3-92a4-bf19563d1352 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:11 user nova-compute[70659]: WARNING nova.compute.manager [req-0e1c3105-c25b-4fca-872f-3c8fd6b682d7 req-956ac7c3-b77a-46e3-92a4-bf19563d1352 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state stopped and task_state powering-on.
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303812.245511, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] VM Resumed (Lifecycle Event)
Jul 25 16:50:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance rebooted successfully.
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-664528c6-2597-44bb-9fd5-ed6d36395b22 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Instance destroyed successfully.
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.objects.instance [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lazy-loading 'resources' on Instance uuid 98c0757f-7146-48ea-ac36-e7c107e74d73 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303812.2492998, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] VM Started (Lifecycle Event)
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1873556572',display_name='tempest-TestVolumeSwap-server-1873556572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1873556572',id=10,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoGemF4reNituil1ug3LIAXgVx78D+iciifOQhindLjWetP2/lFnSNYyXxaPAZQEGhi4fXO7qeTXdiRiGeU0koi/7ws3txCj4pxJtyRoOFQtZJMbo+nkHeJ4NY8NC+pFg==',key_name='tempest-keypair-637778745',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76c8d9889d484385a4e5e2140d7134ff',ramdisk_id='',reservation_id='r-ipubf96l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1956469207',owner_user_name='tempest-TestVolumeSwap-1956469207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b454e0356d247259a4f6c58aa18c6eb',uuid=98c0757f-7146-48ea-ac36-e7c107e74d73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Converting VIF {"id": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "address": "fa:16:3e:bd:02:a4", "network": {"id": "89bdacca-5cda-4182-a752-a05d38815546", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1142626120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76c8d9889d484385a4e5e2140d7134ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape09bb48a-ae", "ovs_interfaceid": "e09bb48a-aed2-4377-9b1b-cfbd077068ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:02:a4,bridge_name='br-int',has_traffic_filtering=True,id=e09bb48a-aed2-4377-9b1b-cfbd077068ec,network=Network(89bdacca-5cda-4182-a752-a05d38815546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09bb48a-ae') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG os_vif [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:02:a4,bridge_name='br-int',has_traffic_filtering=True,id=e09bb48a-aed2-4377-9b1b-cfbd077068ec,network=Network(89bdacca-5cda-4182-a752-a05d38815546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09bb48a-ae') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape09bb48a-ae, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:12 user nova-compute[70659]: INFO os_vif [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:02:a4,bridge_name='br-int',has_traffic_filtering=True,id=e09bb48a-aed2-4377-9b1b-cfbd077068ec,network=Network(89bdacca-5cda-4182-a752-a05d38815546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape09bb48a-ae')
Jul 25 16:50:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Deleting instance files /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73_del
Jul 25 16:50:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Deletion of /opt/stack/data/nova/instances/98c0757f-7146-48ea-ac36-e7c107e74d73_del complete
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:12 user nova-compute[70659]: INFO nova.compute.manager [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 25 16:50:12 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '23364373763386566', 'path': '/dev/sdd'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364373763386566', 'path': '/dev/sdd'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-905791245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-905791245',id=6,image_ref='ba71fd72-cd33-4493-b536-539dc1f80bac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-37424022',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-xzwkg0n4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member',shelved_at='2023-07-25T16:48:08.323974',shelved_host='user',shelved_image_id='ba71fd72-cd33-4493-b536-539dc1f80bac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:50:12 user nova-compute[70659]:   <uuid>9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a</uuid>
Jul 25 16:50:12 user nova-compute[70659]:   <name>instance-00000006</name>
Jul 25 16:50:12 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:50:12 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:50:12 user nova-compute[70659]:   <metadata>
Jul 25 16:50:12 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:50:12 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:50:12 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-905791245</nova:name>
Jul 25 16:50:12 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:50:11</nova:creationTime>
Jul 25 16:50:12 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:50:12 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:50:12 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:50:12 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:50:12 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:50:12 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:50:12 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:50:12 user nova-compute[70659]:       <nova:owner>
Jul 25 16:50:12 user nova-compute[70659]:         <nova:user uuid="bd26fb262d7b47638bb0a0df0ea10c24">tempest-AttachVolumeShelveTestJSON-569325814-project-member</nova:user>
Jul 25 16:50:12 user nova-compute[70659]:         <nova:project uuid="6b9ac672b01748d191239756a58474c3">tempest-AttachVolumeShelveTestJSON-569325814</nova:project>
Jul 25 16:50:12 user nova-compute[70659]:       </nova:owner>
Jul 25 16:50:12 user nova-compute[70659]:       <nova:root type="image" uuid="ba71fd72-cd33-4493-b536-539dc1f80bac"/>
Jul 25 16:50:12 user nova-compute[70659]:       <nova:ports>
Jul 25 16:50:12 user nova-compute[70659]:         <nova:port uuid="219a0a7f-2318-4e5c-b5da-9f9bf813174a">
Jul 25 16:50:12 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:50:12 user nova-compute[70659]:         </nova:port>
Jul 25 16:50:12 user nova-compute[70659]:       </nova:ports>
Jul 25 16:50:12 user nova-compute[70659]:     </nova:instance>
Jul 25 16:50:12 user nova-compute[70659]:   </metadata>
Jul 25 16:50:12 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:50:12 user nova-compute[70659]:     <system>
Jul 25 16:50:12 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:50:12 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:50:12 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:50:12 user nova-compute[70659]:       <entry name="serial">9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a</entry>
Jul 25 16:50:12 user nova-compute[70659]:       <entry name="uuid">9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a</entry>
Jul 25 16:50:12 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:50:12 user nova-compute[70659]:     </system>
Jul 25 16:50:12 user nova-compute[70659]:   </sysinfo>
Jul 25 16:50:12 user nova-compute[70659]:   <os>
Jul 25 16:50:12 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:50:12 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:50:12 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:50:12 user nova-compute[70659]:   </os>
Jul 25 16:50:12 user nova-compute[70659]:   <features>
Jul 25 16:50:12 user nova-compute[70659]:     <acpi/>
Jul 25 16:50:12 user nova-compute[70659]:     <apic/>
Jul 25 16:50:12 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:50:12 user nova-compute[70659]:   </features>
Jul 25 16:50:12 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:50:12 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:50:12 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:50:12 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:50:12 user nova-compute[70659]:   </clock>
Jul 25 16:50:12 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:50:12 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:50:12 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:50:12 user nova-compute[70659]:   </cpu>
Jul 25 16:50:12 user nova-compute[70659]:   <devices>
Jul 25 16:50:12 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:50:12 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:50:12 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk"/>
Jul 25 16:50:12 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:50:12 user nova-compute[70659]:     </disk>
Jul 25 16:50:12 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:50:12 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:50:12 user nova-compute[70659]:       <source dev="/dev/sdd"/>
Jul 25 16:50:12 user nova-compute[70659]:       <target dev="vdc" bus="virtio"/>
Jul 25 16:50:12 user nova-compute[70659]:       <serial>0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae</serial>
Jul 25 16:50:12 user nova-compute[70659]:     </disk>
Jul 25 16:50:12 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:50:12 user nova-compute[70659]:       <mac address="fa:16:3e:6a:13:1f"/>
Jul 25 16:50:12 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:12 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:50:12 user nova-compute[70659]:       <target dev="tap219a0a7f-23"/>
Jul 25 16:50:12 user nova-compute[70659]:     </interface>
Jul 25 16:50:12 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:50:12 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/console.log" append="off"/>
Jul 25 16:50:12 user nova-compute[70659]:     </serial>
Jul 25 16:50:12 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:50:12 user nova-compute[70659]:     <video>
Jul 25 16:50:12 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:12 user nova-compute[70659]:     </video>
Jul 25 16:50:12 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:50:12 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:50:12 user nova-compute[70659]:     </rng>
Jul 25 16:50:12 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:50:12 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:50:12 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:50:12 user nova-compute[70659]:     </memballoon>
Jul 25 16:50:12 user nova-compute[70659]:   </devices>
Jul 25 16:50:12 user nova-compute[70659]: </domain>
Jul 25 16:50:12 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-905791245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-905791245',id=6,image_ref='ba71fd72-cd33-4493-b536-539dc1f80bac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-37424022',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-xzwkg0n4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member',shelved_at='2023-07-25T16:48:08.323974',shelved_host='user',shelved_image_id='ba71fd72-cd33-4493-b536-539dc1f80bac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG os_vif [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap219a0a7f-23, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap219a0a7f-23, col_values=(('external_ids', {'iface-id': '219a0a7f-2318-4e5c-b5da-9f9bf813174a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:13:1f', 'vm-uuid': '9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:12 user nova-compute[70659]: INFO os_vif [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23')
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:50:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] No VIF found with MAC fa:16:3e:6a:13:1f, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:50:13 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Took 0.92 seconds to deallocate network for instance.
Jul 25 16:50:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-1d6cc615-4345-4ee7-a758-e81ddec83feb req-11ba3e4d-0791-4843-9cd9-7f366a0f72f6 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received event network-vif-deleted-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-30989890-84c5-4524-a4bf-d5ed4c122d18 req-e25f4697-9a36-48d7-b3d6-92a67f77f577 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received event network-vif-plugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-30989890-84c5-4524-a4bf-d5ed4c122d18 req-e25f4697-9a36-48d7-b3d6-92a67f77f577 service nova] Acquiring lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-30989890-84c5-4524-a4bf-d5ed4c122d18 req-e25f4697-9a36-48d7-b3d6-92a67f77f577 service nova] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-30989890-84c5-4524-a4bf-d5ed4c122d18 req-e25f4697-9a36-48d7-b3d6-92a67f77f577 service nova] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-30989890-84c5-4524-a4bf-d5ed4c122d18 req-e25f4697-9a36-48d7-b3d6-92a67f77f577 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] No waiting events found dispatching network-vif-plugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:13 user nova-compute[70659]: WARNING nova.compute.manager [req-30989890-84c5-4524-a4bf-d5ed4c122d18 req-e25f4697-9a36-48d7-b3d6-92a67f77f577 service nova] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Received unexpected event network-vif-plugged-e09bb48a-aed2-4377-9b1b-cfbd077068ec for instance with vm_state deleted and task_state None.
Jul 25 16:50:13 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Deleted allocations for instance 98c0757f-7146-48ea-ac36-e7c107e74d73
Jul 25 16:50:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6b644486-05fe-4ba0-92ce-c7ce566b3565 tempest-TestVolumeSwap-1956469207 tempest-TestVolumeSwap-1956469207-project-member] Lock "98c0757f-7146-48ea-ac36-e7c107e74d73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.515s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] No waiting events found dispatching network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:15 user nova-compute[70659]: WARNING nova.compute.manager [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received unexpected event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 16:50:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] No waiting events found dispatching network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:15 user nova-compute[70659]: WARNING nova.compute.manager [req-ec9c9181-a27d-4107-8161-a058a4e37720 req-fa449388-8207-44f7-b5f2-2d14f3c4229c service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received unexpected event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 16:50:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:17 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303817.1435196, 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:17 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] VM Resumed (Lifecycle Event)
Jul 25 16:50:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:50:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:50:17 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance spawned successfully.
Jul 25 16:50:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:17 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:50:17 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303817.1457925, 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:17 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] VM Started (Lifecycle Event)
Jul 25 16:50:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:17 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:50:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ebfb55fc-eed2-4090-b89a-2ebfa2282e19 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.698s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303804.0997522, 5192b767-96f0-4789-ac74-0d6d6b5bef3e => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:19 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] VM Stopped (Lifecycle Event)
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-34ff4d41-19ef-4dd2-adfa-937ec6fe86d7 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-34ff4d41-19ef-4dd2-adfa-937ec6fe86d7 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:19 user nova-compute[70659]: INFO nova.compute.manager [None req-34ff4d41-19ef-4dd2-adfa-937ec6fe86d7 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-311ccc65-85a0-4d42-a965-407b6e926f6f req-9026ab33-0497-443f-aa33-7efc30f143dd service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event volume-reimaged-b5c8d082-5cb7-44e9-b086-4de249762252 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-311ccc65-85a0-4d42-a965-407b6e926f6f req-9026ab33-0497-443f-aa33-7efc30f143dd service nova] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-311ccc65-85a0-4d42-a965-407b6e926f6f req-9026ab33-0497-443f-aa33-7efc30f143dd service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-311ccc65-85a0-4d42-a965-407b6e926f6f req-9026ab33-0497-443f-aa33-7efc30f143dd service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-311ccc65-85a0-4d42-a965-407b6e926f6f req-9026ab33-0497-443f-aa33-7efc30f143dd service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Processing event volume-reimaged-b5c8d082-5cb7-44e9-b086-4de249762252 {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10772}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:50:19 user nova-compute[70659]: INFO nova.virt.block_device [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Booting with volume b5c8d082-5cb7-44e9-b086-4de249762252 at /dev/vda
Jul 25 16:50:19 user nova-compute[70659]: DEBUG os_brick.utils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7262aff-9e49-476d-8383-2a02e6c69460]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e58a3a-2e37-440d-b5bc-b85c80f88590]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[347e009e-2d22-42b9-a5b5-bda7eaa8840a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ec5aca-ad84-4123-ad80-7dc614cef20c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:50:19 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5784206-2b4a-4eaa-a1f4-34a921bffefb]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG os_brick.utils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Updating existing volume attachment record: 90c94e5d-837c-45d3-a510-438d5e0ce509 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Starting finish_migration {{(pid=70659) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance directory exists: not creating {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 16:50:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Creating image(s)
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.objects.instance [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.170s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk. size=21474836480 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:50:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk 21474836480 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk 21474836480" returned: 0 in 0.057s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Ensure instance console log exists: /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Start _get_guest_xml network_info=[{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-863559494-network", "vif_mac": "fa:16:3e:3b:ca:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '10801b25-1641-4c7f-8e90-bfdca74a90cb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5192b767-96f0-4789-ac74-0d6d6b5bef3e', 'attached_at': '2023-07-25T16:50:19.000000', 'detached_at': '', 'volume_id': 'a42f574e-bafc-4e90-9fc2-f92970561add', 'serial': 'a42f574e-bafc-4e90-9fc2-f92970561add'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:50:20 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:20 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.objects.instance [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:50:20 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:20 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:20 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb91d07-23e3-4ca8-862d-fb68ed1259a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:50:20 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0d6dd6-25b0-4746-bdb6-319395ab9697]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add] added
Jul 25 16:50:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcfa509-3290-4859-9b92-c60f96115f1c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d7ac27-d9ab-446c-bc48-9e88cdbc619e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgFjEUbd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgFjEUbd" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4f1905-5b01-498f-9b96-5c117bc7034f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgFjEUbd'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c983cd-c2d3-4125-b627-ce6be8bb8f10]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[214199a7-1819-4a47-8f42-72690ad78a77]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:20 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:20 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[980e6711-eefc-4cc8-9ef2-737eeba9fd34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]
Jul 25 16:50:20 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.
Jul 25 16:50:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8db0b9-ded4-4f3a-92ab-40dd972b2ee9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d4ff3-660b-4e38-b3c1-1061f59a1e86]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:20 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:20 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:50:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:20 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:20 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:50:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:50:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e439c49d-9324-45ff-ad03-c76b29fb4445]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '23866653066636166', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866653066636166', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1071496954',display_name='tempest-ServerActionsTestOtherB-server-1071496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1071496954',id=7,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWJlFb4j8Ys1CPB/bDiS40Ugcuw2Q/xoj3AvPfDyBBFFTZke2FjMd2/DfM6CM24MZfC34jM3nOUoDm3L0rcAn9FD/4h8gEUHn4G9Y2qb8q+bjHLww9szHUFjYPz7u30g==',key_name='tempest-keypair-329454245',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb25024c830544d682f76d9dc10171e2',ramdisk_id='',reservation_id='r-y1z79cx8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1921270631',owner_user_name='tempest-ServerActionsTestOtherB-1921270631-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ebfb3f4c65f4e16be5234a8a4e99e3c',uuid=5192b767-96f0-4789-ac74-0d6d6b5bef3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-863559494-network", "vif_mac": "fa:16:3e:3b:ca:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converting VIF {"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-863559494-network", "vif_mac": "fa:16:3e:3b:ca:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:50:21 user nova-compute[70659]:   <uuid>5192b767-96f0-4789-ac74-0d6d6b5bef3e</uuid>
Jul 25 16:50:21 user nova-compute[70659]:   <name>instance-00000007</name>
Jul 25 16:50:21 user nova-compute[70659]:   <memory>2097152</memory>
Jul 25 16:50:21 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:50:21 user nova-compute[70659]:   <metadata>
Jul 25 16:50:21 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:50:21 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:50:21 user nova-compute[70659]:       <nova:name>tempest-ServerActionsTestOtherB-server-1071496954</nova:name>
Jul 25 16:50:21 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:50:20</nova:creationTime>
Jul 25 16:50:21 user nova-compute[70659]:       <nova:flavor name="m1.small">
Jul 25 16:50:21 user nova-compute[70659]:         <nova:memory>2048</nova:memory>
Jul 25 16:50:21 user nova-compute[70659]:         <nova:disk>20</nova:disk>
Jul 25 16:50:21 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:50:21 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:50:21 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:50:21 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:50:21 user nova-compute[70659]:       <nova:owner>
Jul 25 16:50:21 user nova-compute[70659]:         <nova:user uuid="1ebfb3f4c65f4e16be5234a8a4e99e3c">tempest-ServerActionsTestOtherB-1921270631-project-member</nova:user>
Jul 25 16:50:21 user nova-compute[70659]:         <nova:project uuid="eb25024c830544d682f76d9dc10171e2">tempest-ServerActionsTestOtherB-1921270631</nova:project>
Jul 25 16:50:21 user nova-compute[70659]:       </nova:owner>
Jul 25 16:50:21 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:50:21 user nova-compute[70659]:       <nova:ports>
Jul 25 16:50:21 user nova-compute[70659]:         <nova:port uuid="8f746e90-8b94-4b8c-8c13-02df5983ced0">
Jul 25 16:50:21 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 16:50:21 user nova-compute[70659]:         </nova:port>
Jul 25 16:50:21 user nova-compute[70659]:       </nova:ports>
Jul 25 16:50:21 user nova-compute[70659]:     </nova:instance>
Jul 25 16:50:21 user nova-compute[70659]:   </metadata>
Jul 25 16:50:21 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:50:21 user nova-compute[70659]:     <system>
Jul 25 16:50:21 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:50:21 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:50:21 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:50:21 user nova-compute[70659]:       <entry name="serial">5192b767-96f0-4789-ac74-0d6d6b5bef3e</entry>
Jul 25 16:50:21 user nova-compute[70659]:       <entry name="uuid">5192b767-96f0-4789-ac74-0d6d6b5bef3e</entry>
Jul 25 16:50:21 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:50:21 user nova-compute[70659]:     </system>
Jul 25 16:50:21 user nova-compute[70659]:   </sysinfo>
Jul 25 16:50:21 user nova-compute[70659]:   <os>
Jul 25 16:50:21 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:50:21 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:50:21 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:50:21 user nova-compute[70659]:   </os>
Jul 25 16:50:21 user nova-compute[70659]:   <features>
Jul 25 16:50:21 user nova-compute[70659]:     <acpi/>
Jul 25 16:50:21 user nova-compute[70659]:     <apic/>
Jul 25 16:50:21 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:50:21 user nova-compute[70659]:   </features>
Jul 25 16:50:21 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:50:21 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:50:21 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:50:21 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:50:21 user nova-compute[70659]:   </clock>
Jul 25 16:50:21 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:50:21 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:50:21 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:50:21 user nova-compute[70659]:   </cpu>
Jul 25 16:50:21 user nova-compute[70659]:   <devices>
Jul 25 16:50:21 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:50:21 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:50:21 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk"/>
Jul 25 16:50:21 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:50:21 user nova-compute[70659]:     </disk>
Jul 25 16:50:21 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:50:21 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:50:21 user nova-compute[70659]:       <source dev="/dev/sdc"/>
Jul 25 16:50:21 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 16:50:21 user nova-compute[70659]:       <serial>a42f574e-bafc-4e90-9fc2-f92970561add</serial>
Jul 25 16:50:21 user nova-compute[70659]:     </disk>
Jul 25 16:50:21 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:50:21 user nova-compute[70659]:       <mac address="fa:16:3e:3b:ca:b5"/>
Jul 25 16:50:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:21 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:50:21 user nova-compute[70659]:       <target dev="tap8f746e90-8b"/>
Jul 25 16:50:21 user nova-compute[70659]:     </interface>
Jul 25 16:50:21 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:50:21 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/console.log" append="off"/>
Jul 25 16:50:21 user nova-compute[70659]:     </serial>
Jul 25 16:50:21 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:50:21 user nova-compute[70659]:     <video>
Jul 25 16:50:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:21 user nova-compute[70659]:     </video>
Jul 25 16:50:21 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:50:21 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:50:21 user nova-compute[70659]:     </rng>
Jul 25 16:50:21 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:50:21 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:50:21 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:50:21 user nova-compute[70659]:     </memballoon>
Jul 25 16:50:21 user nova-compute[70659]:   </devices>
Jul 25 16:50:21 user nova-compute[70659]: </domain>
Jul 25 16:50:21 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1071496954',display_name='tempest-ServerActionsTestOtherB-server-1071496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1071496954',id=7,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWJlFb4j8Ys1CPB/bDiS40Ugcuw2Q/xoj3AvPfDyBBFFTZke2FjMd2/DfM6CM24MZfC34jM3nOUoDm3L0rcAn9FD/4h8gEUHn4G9Y2qb8q+bjHLww9szHUFjYPz7u30g==',key_name='tempest-keypair-329454245',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb25024c830544d682f76d9dc10171e2',ramdisk_id='',reservation_id='r-y1z79cx8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1921270631',owner_user_name='tempest-ServerActionsTestOtherB-1921270631-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ebfb3f4c65f4e16be5234a8a4e99e3c',uuid=5192b767-96f0-4789-ac74-0d6d6b5bef3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-863559494-network", "vif_mac": "fa:16:3e:3b:ca:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converting VIF {"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-863559494-network", "vif_mac": "fa:16:3e:3b:ca:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG os_vif [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f746e90-8b, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f746e90-8b, col_values=(('external_ids', {'iface-id': '8f746e90-8b94-4b8c-8c13-02df5983ced0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ca:b5', 'vm-uuid': '5192b767-96f0-4789-ac74-0d6d6b5bef3e'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:50:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:21 user nova-compute[70659]: INFO os_vif [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b')
Jul 25 16:50:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:50:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:50:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] No VIF found with MAC fa:16:3e:3b:ca:b5, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:50:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-b7082fa7-ac4a-4a83-b576-8244824602ea req-3d82bd13-2eac-47a9-bcb4-e228d9209993 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b7082fa7-ac4a-4a83-b576-8244824602ea req-3d82bd13-2eac-47a9-bcb4-e228d9209993 service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b7082fa7-ac4a-4a83-b576-8244824602ea req-3d82bd13-2eac-47a9-bcb4-e228d9209993 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b7082fa7-ac4a-4a83-b576-8244824602ea req-3d82bd13-2eac-47a9-bcb4-e228d9209993 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-b7082fa7-ac4a-4a83-b576-8244824602ea req-3d82bd13-2eac-47a9-bcb4-e228d9209993 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:24 user nova-compute[70659]: WARNING nova.compute.manager [req-b7082fa7-ac4a-4a83-b576-8244824602ea req-3d82bd13-2eac-47a9-bcb4-e228d9209993 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state active and task_state resize_finish.
Jul 25 16:50:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-04c10fb5-33af-4bfc-b455-524185af21d9 req-d4abf791-c720-44ce-80ba-7c75b79ed465 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-04c10fb5-33af-4bfc-b455-524185af21d9 req-d4abf791-c720-44ce-80ba-7c75b79ed465 service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-04c10fb5-33af-4bfc-b455-524185af21d9 req-d4abf791-c720-44ce-80ba-7c75b79ed465 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-04c10fb5-33af-4bfc-b455-524185af21d9 req-d4abf791-c720-44ce-80ba-7c75b79ed465 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-04c10fb5-33af-4bfc-b455-524185af21d9 req-d4abf791-c720-44ce-80ba-7c75b79ed465 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:26 user nova-compute[70659]: WARNING nova.compute.manager [req-04c10fb5-33af-4bfc-b455-524185af21d9 req-d4abf791-c720-44ce-80ba-7c75b79ed465 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state active and task_state resize_finish.
Jul 25 16:50:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303826.380139, 5192b767-96f0-4789-ac74-0d6d6b5bef3e => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:26 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] VM Resumed (Lifecycle Event)
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:50:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance running successfully.
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Failed to set time: agent not configured {{(pid=70659) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-22335bd1-8e8a-4759-9848-261c535fdf4f tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] finish_migration finished successfully. {{(pid=70659) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:26 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303826.382538, 5192b767-96f0-4789-ac74-0d6d6b5bef3e => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:26 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] VM Started (Lifecycle Event)
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:26 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 16:50:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:27 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303812.2794125, 98c0757f-7146-48ea-ac36-e7c107e74d73 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:27 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] VM Stopped (Lifecycle Event)
Jul 25 16:50:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ee105ed2-cfdd-47b7-a0f8-38deafbeb4db None None] [instance: 98c0757f-7146-48ea-ac36-e7c107e74d73] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:50:29 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Creating image(s)
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Ensure instance console log exists: /opt/stack/data/nova/instances/6f6117f9-a000-4491-bd38-b7525298c23a/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Start _get_guest_xml network_info=[{"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '90c94e5d-837c-45d3-a510-438d5e0ce509', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFZiMvGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f6117f9-a000-4491-bd38-b7525298c23a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5c8d082-5cb7-44e9-b086-4de249762252', 'serial': 'b5c8d082-5cb7-44e9-b086-4de249762252'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:50:29 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 16:50:29 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f6117f9-a000-4491-bd38-b7525298c23a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFZiMvGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:50:29 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:29 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:50:29 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7846b688-97e1-4809-9539-3f3c61a61f31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:50:29 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff7ada4-2f25-4cc8-a2b9-22cda1a4c587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252] added
Jul 25 16:50:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae6af29-94ab-45ec-999c-a4e63e45839d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[15176f48-4628-4603-a895-c44fed25822c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jFZiMvGq {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jFZiMvGq" returned: 0 in 0.043s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[052fd238-5302-4c69-8318-fb1360daef9a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jFZiMvGq'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c32aff-537b-495b-a2b9-ba96f69a3e8f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f942225-bd40-49c3-8a45-3e3418421eef]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:50:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:50:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71f0bf4-7b30-4301-aab2-e140fade5621]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260]
Jul 25 16:50:29 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260] successful.
Jul 25 16:50:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e20813-0085-41ce-9a5d-9de17cfe8bf1]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb8a4b3-d70b-4665-be56-8ab5e76ab578]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:50:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:50:29 user nova-compute[70659]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:50:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8c01c2-c8d8-4926-8bcf-bebfdd874287]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:50:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFZiMvGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '23865333961303265', 'path': '/dev/sde'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865333961303265', 'path': '/dev/sde'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1867016362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1510861238',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdrrnEIsPtiOyPXZwZDkWWdRWRmg5eRltyImohYN5f/QNID4CDxf10xSW043jjUbCODnxMzL1McqL4p/4z9m7F1bT8oACH9CMyevg1NsoxnXEziUsCowS7fJm1RWMTB9A==',key_name='tempest-keypair-1581675553',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:48:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fa87ca828941408ebb81eb439ebbc79e',ramdisk_id='',reservation_id='r-66ri7r0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510925623',owner_user_name='tempest-ServerActionsV293TestJSON-510925623-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad466988c34f4e06b5c631b9754db2c5',uuid=6f6117f9-a000-4491-bd38-b7525298c23a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converting VIF {"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:50:30 user nova-compute[70659]:   <uuid>6f6117f9-a000-4491-bd38-b7525298c23a</uuid>
Jul 25 16:50:30 user nova-compute[70659]:   <name>instance-0000000d</name>
Jul 25 16:50:30 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:50:30 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:50:30 user nova-compute[70659]:   <metadata>
Jul 25 16:50:30 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:50:30 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:50:30 user nova-compute[70659]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1867016362</nova:name>
Jul 25 16:50:30 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:50:29</nova:creationTime>
Jul 25 16:50:30 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:50:30 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:50:30 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:50:30 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:50:30 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:50:30 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:50:30 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:50:30 user nova-compute[70659]:       <nova:owner>
Jul 25 16:50:30 user nova-compute[70659]:         <nova:user uuid="ad466988c34f4e06b5c631b9754db2c5">tempest-ServerActionsV293TestJSON-510925623-project-member</nova:user>
Jul 25 16:50:30 user nova-compute[70659]:         <nova:project uuid="fa87ca828941408ebb81eb439ebbc79e">tempest-ServerActionsV293TestJSON-510925623</nova:project>
Jul 25 16:50:30 user nova-compute[70659]:       </nova:owner>
Jul 25 16:50:30 user nova-compute[70659]:       <nova:ports>
Jul 25 16:50:30 user nova-compute[70659]:         <nova:port uuid="31647377-15e8-4c48-a3f9-0601ae9b7493">
Jul 25 16:50:30 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:50:30 user nova-compute[70659]:         </nova:port>
Jul 25 16:50:30 user nova-compute[70659]:       </nova:ports>
Jul 25 16:50:30 user nova-compute[70659]:     </nova:instance>
Jul 25 16:50:30 user nova-compute[70659]:   </metadata>
Jul 25 16:50:30 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:50:30 user nova-compute[70659]:     <system>
Jul 25 16:50:30 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:50:30 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:50:30 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:50:30 user nova-compute[70659]:       <entry name="serial">6f6117f9-a000-4491-bd38-b7525298c23a</entry>
Jul 25 16:50:30 user nova-compute[70659]:       <entry name="uuid">6f6117f9-a000-4491-bd38-b7525298c23a</entry>
Jul 25 16:50:30 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:50:30 user nova-compute[70659]:     </system>
Jul 25 16:50:30 user nova-compute[70659]:   </sysinfo>
Jul 25 16:50:30 user nova-compute[70659]:   <os>
Jul 25 16:50:30 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:50:30 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:50:30 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:50:30 user nova-compute[70659]:   </os>
Jul 25 16:50:30 user nova-compute[70659]:   <features>
Jul 25 16:50:30 user nova-compute[70659]:     <acpi/>
Jul 25 16:50:30 user nova-compute[70659]:     <apic/>
Jul 25 16:50:30 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:50:30 user nova-compute[70659]:   </features>
Jul 25 16:50:30 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:50:30 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:50:30 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:50:30 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:50:30 user nova-compute[70659]:   </clock>
Jul 25 16:50:30 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:50:30 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:50:30 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:50:30 user nova-compute[70659]:   </cpu>
Jul 25 16:50:30 user nova-compute[70659]:   <devices>
Jul 25 16:50:30 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:50:30 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:50:30 user nova-compute[70659]:       <source dev="/dev/sde"/>
Jul 25 16:50:30 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:50:30 user nova-compute[70659]:       <serial>b5c8d082-5cb7-44e9-b086-4de249762252</serial>
Jul 25 16:50:30 user nova-compute[70659]:     </disk>
Jul 25 16:50:30 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:50:30 user nova-compute[70659]:       <mac address="fa:16:3e:39:7b:c1"/>
Jul 25 16:50:30 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:30 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:50:30 user nova-compute[70659]:       <target dev="tap31647377-15"/>
Jul 25 16:50:30 user nova-compute[70659]:     </interface>
Jul 25 16:50:30 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:50:30 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/6f6117f9-a000-4491-bd38-b7525298c23a/console.log" append="off"/>
Jul 25 16:50:30 user nova-compute[70659]:     </serial>
Jul 25 16:50:30 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:50:30 user nova-compute[70659]:     <video>
Jul 25 16:50:30 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:30 user nova-compute[70659]:     </video>
Jul 25 16:50:30 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:50:30 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:50:30 user nova-compute[70659]:     </rng>
Jul 25 16:50:30 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:50:30 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:50:30 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:50:30 user nova-compute[70659]:     </memballoon>
Jul 25 16:50:30 user nova-compute[70659]:   </devices>
Jul 25 16:50:30 user nova-compute[70659]: </domain>
Jul 25 16:50:30 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1867016362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1510861238',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdrrnEIsPtiOyPXZwZDkWWdRWRmg5eRltyImohYN5f/QNID4CDxf10xSW043jjUbCODnxMzL1McqL4p/4z9m7F1bT8oACH9CMyevg1NsoxnXEziUsCowS7fJm1RWMTB9A==',key_name='tempest-keypair-1581675553',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:48:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fa87ca828941408ebb81eb439ebbc79e',ramdisk_id='',reservation_id='r-66ri7r0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510925623',owner_user_name='tempest-ServerActionsV293TestJSON-510925623-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad466988c34f4e06b5c631b9754db2c5',uuid=6f6117f9-a000-4491-bd38-b7525298c23a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converting VIF {"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG os_vif [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31647377-15, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31647377-15, col_values=(('external_ids', {'iface-id': '31647377-15e8-4c48-a3f9-0601ae9b7493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:7b:c1', 'vm-uuid': '6f6117f9-a000-4491-bd38-b7525298c23a'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:30 user nova-compute[70659]: INFO os_vif [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15')
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:50:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] No VIF found with MAC fa:16:3e:39:7b:c1, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:50:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:33 user nova-compute[70659]: DEBUG nova.compute.manager [req-5af3f096-2ac8-4d99-b56e-df799b3f9d27 req-ad67c146-2984-41e7-9ef0-13ae53677f0f service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5af3f096-2ac8-4d99-b56e-df799b3f9d27 req-ad67c146-2984-41e7-9ef0-13ae53677f0f service nova] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5af3f096-2ac8-4d99-b56e-df799b3f9d27 req-ad67c146-2984-41e7-9ef0-13ae53677f0f service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5af3f096-2ac8-4d99-b56e-df799b3f9d27 req-ad67c146-2984-41e7-9ef0-13ae53677f0f service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:33 user nova-compute[70659]: DEBUG nova.compute.manager [req-5af3f096-2ac8-4d99-b56e-df799b3f9d27 req-ad67c146-2984-41e7-9ef0-13ae53677f0f service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] No waiting events found dispatching network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:33 user nova-compute[70659]: WARNING nova.compute.manager [req-5af3f096-2ac8-4d99-b56e-df799b3f9d27 req-ad67c146-2984-41e7-9ef0-13ae53677f0f service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received unexpected event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 for instance with vm_state active and task_state rebuild_spawning.
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303835.0921507, 6f6117f9-a000-4491-bd38-b7525298c23a => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:35 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] VM Resumed (Lifecycle Event)
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:50:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance spawned successfully.
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:50:35 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303835.0977018, 6f6117f9-a000-4491-bd38-b7525298c23a => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:35 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] VM Started (Lifecycle Event)
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:35 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 16:50:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70659) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311ccc65-85a0-4d42-a965-407b6e926f6f tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-f8e0c861-4724-4a9d-9e65-f13474b8d8d9 req-1ac91a5d-3235-48f6-86f7-4ecc3fcd2548 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f8e0c861-4724-4a9d-9e65-f13474b8d8d9 req-1ac91a5d-3235-48f6-86f7-4ecc3fcd2548 service nova] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f8e0c861-4724-4a9d-9e65-f13474b8d8d9 req-1ac91a5d-3235-48f6-86f7-4ecc3fcd2548 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f8e0c861-4724-4a9d-9e65-f13474b8d8d9 req-1ac91a5d-3235-48f6-86f7-4ecc3fcd2548 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-f8e0c861-4724-4a9d-9e65-f13474b8d8d9 req-1ac91a5d-3235-48f6-86f7-4ecc3fcd2548 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] No waiting events found dispatching network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:35 user nova-compute[70659]: WARNING nova.compute.manager [req-f8e0c861-4724-4a9d-9e65-f13474b8d8d9 req-1ac91a5d-3235-48f6-86f7-4ecc3fcd2548 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received unexpected event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 for instance with vm_state active and task_state None.
Jul 25 16:50:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:41 user nova-compute[70659]: INFO nova.compute.manager [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Rescuing
Jul 25 16:50:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:50:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquired lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:50:41 user nova-compute[70659]: DEBUG nova.network.neutron [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:50:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:50:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:50:43 user nova-compute[70659]: DEBUG nova.network.neutron [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updating instance_info_cache with network_info: [{"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:50:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Releasing lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:50:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-a318ec8e-b085-4609-8c4b-86a3bfc68d0a req-843e4ae5-8983-4836-8e1b-96da27afa885 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a318ec8e-b085-4609-8c4b-86a3bfc68d0a req-843e4ae5-8983-4836-8e1b-96da27afa885 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a318ec8e-b085-4609-8c4b-86a3bfc68d0a req-843e4ae5-8983-4836-8e1b-96da27afa885 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a318ec8e-b085-4609-8c4b-86a3bfc68d0a req-843e4ae5-8983-4836-8e1b-96da27afa885 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-a318ec8e-b085-4609-8c4b-86a3bfc68d0a req-843e4ae5-8983-4836-8e1b-96da27afa885 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:44 user nova-compute[70659]: WARNING nova.compute.manager [req-a318ec8e-b085-4609-8c4b-86a3bfc68d0a req-843e4ae5-8983-4836-8e1b-96da27afa885 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state active and task_state rescuing.
Jul 25 16:50:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:44 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Instance destroyed successfully.
Jul 25 16:50:44 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Attempting rescue
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70659) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Instance directory exists: not creating {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 16:50:44 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Creating image(s)
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'trusted_certs' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.223s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue" returned: 0 in 0.051s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'migration_context' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Start _get_guest_xml network_info=[{"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "vif_mac": "fa:16:3e:98:c5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'resources' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'numa_topology' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:44 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:44 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'vcpu_model' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1476762347',display_name='tempest-ServerRescueNegativeTestJSON-server-1476762347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1476762347',id=1,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-1l240my5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:46:08Z,user_data=None,user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=c2800889-2d2e-4660-8bc9-f1f1782587d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "vif_mac": "fa:16:3e:98:c5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "vif_mac": "fa:16:3e:98:c5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:c5:8a,bridge_name='br-int',has_traffic_filtering=True,id=c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f4caf2-a4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'pci_devices' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:50:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:50:44 user nova-compute[70659]:   <uuid>c2800889-2d2e-4660-8bc9-f1f1782587d3</uuid>
Jul 25 16:50:44 user nova-compute[70659]:   <name>instance-00000001</name>
Jul 25 16:50:44 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:50:44 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:50:44 user nova-compute[70659]:   <metadata>
Jul 25 16:50:44 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:50:44 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:50:44 user nova-compute[70659]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1476762347</nova:name>
Jul 25 16:50:44 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:50:44</nova:creationTime>
Jul 25 16:50:44 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:50:44 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:50:44 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:50:44 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:50:44 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:50:44 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:50:44 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:50:44 user nova-compute[70659]:       <nova:owner>
Jul 25 16:50:44 user nova-compute[70659]:         <nova:user uuid="9aaa70e5cce7418b96837e30769ac6aa">tempest-ServerRescueNegativeTestJSON-1539045365-project-member</nova:user>
Jul 25 16:50:44 user nova-compute[70659]:         <nova:project uuid="d20acc57667b418ba16f573fe81841ac">tempest-ServerRescueNegativeTestJSON-1539045365</nova:project>
Jul 25 16:50:44 user nova-compute[70659]:       </nova:owner>
Jul 25 16:50:44 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:50:44 user nova-compute[70659]:       <nova:ports>
Jul 25 16:50:44 user nova-compute[70659]:         <nova:port uuid="c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1">
Jul 25 16:50:44 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 16:50:44 user nova-compute[70659]:         </nova:port>
Jul 25 16:50:44 user nova-compute[70659]:       </nova:ports>
Jul 25 16:50:44 user nova-compute[70659]:     </nova:instance>
Jul 25 16:50:44 user nova-compute[70659]:   </metadata>
Jul 25 16:50:44 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:50:44 user nova-compute[70659]:     <system>
Jul 25 16:50:44 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:50:44 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:50:44 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:50:44 user nova-compute[70659]:       <entry name="serial">c2800889-2d2e-4660-8bc9-f1f1782587d3</entry>
Jul 25 16:50:44 user nova-compute[70659]:       <entry name="uuid">c2800889-2d2e-4660-8bc9-f1f1782587d3</entry>
Jul 25 16:50:44 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:50:44 user nova-compute[70659]:     </system>
Jul 25 16:50:44 user nova-compute[70659]:   </sysinfo>
Jul 25 16:50:44 user nova-compute[70659]:   <os>
Jul 25 16:50:44 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:50:44 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:50:44 user nova-compute[70659]:   </os>
Jul 25 16:50:44 user nova-compute[70659]:   <features>
Jul 25 16:50:44 user nova-compute[70659]:     <acpi/>
Jul 25 16:50:44 user nova-compute[70659]:     <apic/>
Jul 25 16:50:44 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:50:44 user nova-compute[70659]:   </features>
Jul 25 16:50:44 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:50:44 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:50:44 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:50:44 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:50:44 user nova-compute[70659]:   </clock>
Jul 25 16:50:44 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:50:44 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:50:44 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:50:44 user nova-compute[70659]:   </cpu>
Jul 25 16:50:44 user nova-compute[70659]:   <devices>
Jul 25 16:50:44 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:50:44 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:50:44 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue"/>
Jul 25 16:50:44 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:50:44 user nova-compute[70659]:     </disk>
Jul 25 16:50:44 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:50:44 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:50:44 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk"/>
Jul 25 16:50:44 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 16:50:44 user nova-compute[70659]:     </disk>
Jul 25 16:50:44 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:50:44 user nova-compute[70659]:       <mac address="fa:16:3e:98:c5:8a"/>
Jul 25 16:50:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:44 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:50:44 user nova-compute[70659]:       <target dev="tapc6f4caf2-a4"/>
Jul 25 16:50:44 user nova-compute[70659]:     </interface>
Jul 25 16:50:44 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:50:44 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/console.log" append="off"/>
Jul 25 16:50:44 user nova-compute[70659]:     </serial>
Jul 25 16:50:44 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:50:44 user nova-compute[70659]:     <video>
Jul 25 16:50:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:50:44 user nova-compute[70659]:     </video>
Jul 25 16:50:44 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:50:44 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:50:44 user nova-compute[70659]:     </rng>
Jul 25 16:50:44 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:50:44 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:50:44 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:50:44 user nova-compute[70659]:     </memballoon>
Jul 25 16:50:44 user nova-compute[70659]:   </devices>
Jul 25 16:50:44 user nova-compute[70659]: </domain>
Jul 25 16:50:44 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:45 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Instance destroyed successfully.
Jul 25 16:50:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No VIF found with MAC fa:16:3e:98:c5:8a, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:50:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:46 user nova-compute[70659]: WARNING nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state active and task_state rescuing.
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:46 user nova-compute[70659]: WARNING nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state active and task_state rescuing.
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:46 user nova-compute[70659]: WARNING nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state active and task_state rescuing.
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:46 user nova-compute[70659]: WARNING nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state active and task_state rescuing.
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:46 user nova-compute[70659]: WARNING nova.compute.manager [req-fb266a41-5f2c-44d8-af1b-8e030b8094c3 req-72b5acfa-88d2-47b2-b5b8-173b74dd9b33 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state active and task_state rescuing.
Jul 25 16:50:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:48 user nova-compute[70659]: WARNING nova.compute.manager [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state active and task_state rescuing.
Jul 25 16:50:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:50:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:50:48 user nova-compute[70659]: WARNING nova.compute.manager [req-70273afe-292c-48ab-bb4c-0bcc33b284af req-acab9feb-8a48-48f7-86cf-ef9fa2eecab8 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state active and task_state rescuing.
Jul 25 16:50:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for c2800889-2d2e-4660-8bc9-f1f1782587d3 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303849.244457, c2800889-2d2e-4660-8bc9-f1f1782587d3 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] VM Resumed (Lifecycle Event)
Jul 25 16:50:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9b2193a2-99ba-4ca0-8678-3a9bc4f45c45 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 16:50:49 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303849.2510035, c2800889-2d2e-4660-8bc9-f1f1782587d3 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:50:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] VM Started (Lifecycle Event)
Jul 25 16:50:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:50:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:50:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:50:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:50:53 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:53 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7738MB free_disk=25.59903335571289GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Applying migration context for instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e as it has an incoming, in-progress migration 882997f6-8615-4f80-a72b-4f8c33f47863. Migration status is finished {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 16:50:53 user nova-compute[70659]: INFO nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating resource usage from migration 882997f6-8615-4f80-a72b-4f8c33f47863
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c9728d00-f454-4616-af0b-8cfd0f012cad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 6f6117f9-a000-4491-bd38-b7525298c23a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Migration 882997f6-8615-4f80-a72b-4f8c33f47863 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:50:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:50:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:50:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:50:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:50:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:50:55 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:50:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:56 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updating instance_info_cache with network_info: [{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:50:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:50:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:50:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:50:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:50:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:50:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:50:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "fc09d930-4a75-490b-a86a-08fe432d778c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "fc09d930-4a75-490b-a86a-08fe432d778c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:51:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:51:04 user nova-compute[70659]: INFO nova.compute.claims [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Claim successful on node user
Jul 25 16:51:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:51:05 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.policy [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '913d51a0ff3746c5bdadd59fdf14e787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef5ee6f08d04772994840a8973da621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:51:05 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Creating image(s)
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "/opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "/opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:51:06 user nova-compute[70659]: INFO nova.compute.claims [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Claim successful on node user
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk 1073741824" returned: 0 in 0.072s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Successfully created port: 730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.257s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Cannot resize image /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'migration_context' on Instance uuid fc09d930-4a75-490b-a86a-08fe432d778c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Ensure instance console log exists: /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.802s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:51:06 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:51:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.policy [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c06f1babb164e4e9ae334ad5c81ab65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2a00920ce74688937a25cb3db3dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:51:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Creating image(s)
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "/opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "/opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Successfully updated port: 730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquired lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.180s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk 1073741824" returned: 0 in 0.057s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-c02c6b4f-a220-4c10-b799-8804150189f8 req-6008002f-e441-4262-b98d-4c308a86acc5 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received event network-changed-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-c02c6b4f-a220-4c10-b799-8804150189f8 req-6008002f-e441-4262-b98d-4c308a86acc5 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Refreshing instance network info cache due to event network-changed-730a2576-6812-47eb-8d54-c86e3c97f7d6. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c02c6b4f-a220-4c10-b799-8804150189f8 req-6008002f-e441-4262-b98d-4c308a86acc5 service nova] Acquiring lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.241s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Cannot resize image /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lazy-loading 'migration_context' on Instance uuid f3dc2e56-b192-4e05-bb09-468d85f9cf75 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Ensure instance console log exists: /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updating instance_info_cache with network_info: [{"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Releasing lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Instance network_info: |[{"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c02c6b4f-a220-4c10-b799-8804150189f8 req-6008002f-e441-4262-b98d-4c308a86acc5 service nova] Acquired lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-c02c6b4f-a220-4c10-b799-8804150189f8 req-6008002f-e441-4262-b98d-4c308a86acc5 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Refreshing network info cache for port 730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Start _get_guest_xml network_info=[{"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:51:08 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:51:08 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-3393127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-3393127',id=14,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-ol839oyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:51:06Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=fc09d930-4a75-490b-a86a-08fe432d778c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=730a2576-6812-47eb-8d54-c86e3c97f7d6,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730a2576-68') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'pci_devices' on Instance uuid fc09d930-4a75-490b-a86a-08fe432d778c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:51:08 user nova-compute[70659]:   <uuid>fc09d930-4a75-490b-a86a-08fe432d778c</uuid>
Jul 25 16:51:08 user nova-compute[70659]:   <name>instance-0000000e</name>
Jul 25 16:51:08 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:51:08 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:51:08 user nova-compute[70659]:   <metadata>
Jul 25 16:51:08 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:51:08 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:51:08 user nova-compute[70659]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-3393127</nova:name>
Jul 25 16:51:08 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:51:08</nova:creationTime>
Jul 25 16:51:08 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:51:08 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:51:08 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:51:08 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:51:08 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:51:08 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:51:08 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:51:08 user nova-compute[70659]:       <nova:owner>
Jul 25 16:51:08 user nova-compute[70659]:         <nova:user uuid="913d51a0ff3746c5bdadd59fdf14e787">tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member</nova:user>
Jul 25 16:51:08 user nova-compute[70659]:         <nova:project uuid="1ef5ee6f08d04772994840a8973da621">tempest-ServerBootFromVolumeStableRescueTest-191665891</nova:project>
Jul 25 16:51:08 user nova-compute[70659]:       </nova:owner>
Jul 25 16:51:08 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:51:08 user nova-compute[70659]:       <nova:ports>
Jul 25 16:51:08 user nova-compute[70659]:         <nova:port uuid="730a2576-6812-47eb-8d54-c86e3c97f7d6">
Jul 25 16:51:08 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 16:51:08 user nova-compute[70659]:         </nova:port>
Jul 25 16:51:08 user nova-compute[70659]:       </nova:ports>
Jul 25 16:51:08 user nova-compute[70659]:     </nova:instance>
Jul 25 16:51:08 user nova-compute[70659]:   </metadata>
Jul 25 16:51:08 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:51:08 user nova-compute[70659]:     <system>
Jul 25 16:51:08 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:51:08 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:51:08 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:51:08 user nova-compute[70659]:       <entry name="serial">fc09d930-4a75-490b-a86a-08fe432d778c</entry>
Jul 25 16:51:08 user nova-compute[70659]:       <entry name="uuid">fc09d930-4a75-490b-a86a-08fe432d778c</entry>
Jul 25 16:51:08 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:51:08 user nova-compute[70659]:     </system>
Jul 25 16:51:08 user nova-compute[70659]:   </sysinfo>
Jul 25 16:51:08 user nova-compute[70659]:   <os>
Jul 25 16:51:08 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:51:08 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:51:08 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:51:08 user nova-compute[70659]:   </os>
Jul 25 16:51:08 user nova-compute[70659]:   <features>
Jul 25 16:51:08 user nova-compute[70659]:     <acpi/>
Jul 25 16:51:08 user nova-compute[70659]:     <apic/>
Jul 25 16:51:08 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:51:08 user nova-compute[70659]:   </features>
Jul 25 16:51:08 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:51:08 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:51:08 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:51:08 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:51:08 user nova-compute[70659]:   </clock>
Jul 25 16:51:08 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:51:08 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:51:08 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:51:08 user nova-compute[70659]:   </cpu>
Jul 25 16:51:08 user nova-compute[70659]:   <devices>
Jul 25 16:51:08 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:51:08 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:51:08 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk"/>
Jul 25 16:51:08 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:51:08 user nova-compute[70659]:     </disk>
Jul 25 16:51:08 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:51:08 user nova-compute[70659]:       <mac address="fa:16:3e:c1:31:8a"/>
Jul 25 16:51:08 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:51:08 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:51:08 user nova-compute[70659]:       <target dev="tap730a2576-68"/>
Jul 25 16:51:08 user nova-compute[70659]:     </interface>
Jul 25 16:51:08 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:51:08 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/console.log" append="off"/>
Jul 25 16:51:08 user nova-compute[70659]:     </serial>
Jul 25 16:51:08 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:51:08 user nova-compute[70659]:     <video>
Jul 25 16:51:08 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:51:08 user nova-compute[70659]:     </video>
Jul 25 16:51:08 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:51:08 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:51:08 user nova-compute[70659]:     </rng>
Jul 25 16:51:08 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:51:08 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:51:08 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:51:08 user nova-compute[70659]:     </memballoon>
Jul 25 16:51:08 user nova-compute[70659]:   </devices>
Jul 25 16:51:08 user nova-compute[70659]: </domain>
Jul 25 16:51:08 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-3393127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-3393127',id=14,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-ol839oyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:51:06Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=fc09d930-4a75-490b-a86a-08fe432d778c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=730a2576-6812-47eb-8d54-c86e3c97f7d6,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730a2576-68') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG os_vif [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=730a2576-6812-47eb-8d54-c86e3c97f7d6,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730a2576-68') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap730a2576-68, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap730a2576-68, col_values=(('external_ids', {'iface-id': '730a2576-6812-47eb-8d54-c86e3c97f7d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:31:8a', 'vm-uuid': 'fc09d930-4a75-490b-a86a-08fe432d778c'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:51:08 user nova-compute[70659]: INFO os_vif [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=730a2576-6812-47eb-8d54-c86e3c97f7d6,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730a2576-68')
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No VIF found with MAC fa:16:3e:c1:31:8a, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Successfully created port: 73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-c02c6b4f-a220-4c10-b799-8804150189f8 req-6008002f-e441-4262-b98d-4c308a86acc5 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updated VIF entry in instance network info cache for port 730a2576-6812-47eb-8d54-c86e3c97f7d6. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-c02c6b4f-a220-4c10-b799-8804150189f8 req-6008002f-e441-4262-b98d-4c308a86acc5 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updating instance_info_cache with network_info: [{"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c02c6b4f-a220-4c10-b799-8804150189f8 req-6008002f-e441-4262-b98d-4c308a86acc5 service nova] Releasing lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:51:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-46e15592-b878-4b12-ab0d-d89755f2df46 req-7d8e77a3-0742-4cf5-93e4-070ee8135f02 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received event network-vif-plugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-46e15592-b878-4b12-ab0d-d89755f2df46 req-7d8e77a3-0742-4cf5-93e4-070ee8135f02 service nova] Acquiring lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-46e15592-b878-4b12-ab0d-d89755f2df46 req-7d8e77a3-0742-4cf5-93e4-070ee8135f02 service nova] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-46e15592-b878-4b12-ab0d-d89755f2df46 req-7d8e77a3-0742-4cf5-93e4-070ee8135f02 service nova] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-46e15592-b878-4b12-ab0d-d89755f2df46 req-7d8e77a3-0742-4cf5-93e4-070ee8135f02 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] No waiting events found dispatching network-vif-plugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:10 user nova-compute[70659]: WARNING nova.compute.manager [req-46e15592-b878-4b12-ab0d-d89755f2df46 req-7d8e77a3-0742-4cf5-93e4-070ee8135f02 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received unexpected event network-vif-plugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 for instance with vm_state building and task_state spawning.
Jul 25 16:51:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Successfully updated port: 73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "refresh_cache-f3dc2e56-b192-4e05-bb09-468d85f9cf75" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquired lock "refresh_cache-f3dc2e56-b192-4e05-bb09-468d85f9cf75" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:51:10 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Updating instance_info_cache with network_info: [{"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Releasing lock "refresh_cache-f3dc2e56-b192-4e05-bb09-468d85f9cf75" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Instance network_info: |[{"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Start _get_guest_xml network_info=[{"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:51:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:51:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1358222157',display_name='tempest-ServersNegativeTestJSON-server-1358222157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1358222157',id=15,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a00920ce74688937a25cb3db3dd07',ramdisk_id='',reservation_id='r-3zy4ck2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1085604250',owner_user_name='tempest-ServersNegativeTestJSON-1085604250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:51:07Z,user_data=None,user_id='8c06f1babb164e4e9ae334ad5c81ab65',uuid=f3dc2e56-b192-4e05-bb09-468d85f9cf75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converting VIF {"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a8:61,bridge_name='br-int',has_traffic_filtering=True,id=73daa8f1-c8ee-437c-bf96-d17f57fa1611,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73daa8f1-c8') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lazy-loading 'pci_devices' on Instance uuid f3dc2e56-b192-4e05-bb09-468d85f9cf75 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:51:11 user nova-compute[70659]:   <uuid>f3dc2e56-b192-4e05-bb09-468d85f9cf75</uuid>
Jul 25 16:51:11 user nova-compute[70659]:   <name>instance-0000000f</name>
Jul 25 16:51:11 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:51:11 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:51:11 user nova-compute[70659]:   <metadata>
Jul 25 16:51:11 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:51:11 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:51:11 user nova-compute[70659]:       <nova:name>tempest-ServersNegativeTestJSON-server-1358222157</nova:name>
Jul 25 16:51:11 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:51:11</nova:creationTime>
Jul 25 16:51:11 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:51:11 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:51:11 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:51:11 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:51:11 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:51:11 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:51:11 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:51:11 user nova-compute[70659]:       <nova:owner>
Jul 25 16:51:11 user nova-compute[70659]:         <nova:user uuid="8c06f1babb164e4e9ae334ad5c81ab65">tempest-ServersNegativeTestJSON-1085604250-project-member</nova:user>
Jul 25 16:51:11 user nova-compute[70659]:         <nova:project uuid="5c2a00920ce74688937a25cb3db3dd07">tempest-ServersNegativeTestJSON-1085604250</nova:project>
Jul 25 16:51:11 user nova-compute[70659]:       </nova:owner>
Jul 25 16:51:11 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:51:11 user nova-compute[70659]:       <nova:ports>
Jul 25 16:51:11 user nova-compute[70659]:         <nova:port uuid="73daa8f1-c8ee-437c-bf96-d17f57fa1611">
Jul 25 16:51:11 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 16:51:11 user nova-compute[70659]:         </nova:port>
Jul 25 16:51:11 user nova-compute[70659]:       </nova:ports>
Jul 25 16:51:11 user nova-compute[70659]:     </nova:instance>
Jul 25 16:51:11 user nova-compute[70659]:   </metadata>
Jul 25 16:51:11 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:51:11 user nova-compute[70659]:     <system>
Jul 25 16:51:11 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:51:11 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:51:11 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:51:11 user nova-compute[70659]:       <entry name="serial">f3dc2e56-b192-4e05-bb09-468d85f9cf75</entry>
Jul 25 16:51:11 user nova-compute[70659]:       <entry name="uuid">f3dc2e56-b192-4e05-bb09-468d85f9cf75</entry>
Jul 25 16:51:11 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:51:11 user nova-compute[70659]:     </system>
Jul 25 16:51:11 user nova-compute[70659]:   </sysinfo>
Jul 25 16:51:11 user nova-compute[70659]:   <os>
Jul 25 16:51:11 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:51:11 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:51:11 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:51:11 user nova-compute[70659]:   </os>
Jul 25 16:51:11 user nova-compute[70659]:   <features>
Jul 25 16:51:11 user nova-compute[70659]:     <acpi/>
Jul 25 16:51:11 user nova-compute[70659]:     <apic/>
Jul 25 16:51:11 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:51:11 user nova-compute[70659]:   </features>
Jul 25 16:51:11 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:51:11 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:51:11 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:51:11 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:51:11 user nova-compute[70659]:   </clock>
Jul 25 16:51:11 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:51:11 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:51:11 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:51:11 user nova-compute[70659]:   </cpu>
Jul 25 16:51:11 user nova-compute[70659]:   <devices>
Jul 25 16:51:11 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:51:11 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:51:11 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk"/>
Jul 25 16:51:11 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:51:11 user nova-compute[70659]:     </disk>
Jul 25 16:51:11 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:51:11 user nova-compute[70659]:       <mac address="fa:16:3e:bd:a8:61"/>
Jul 25 16:51:11 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:51:11 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:51:11 user nova-compute[70659]:       <target dev="tap73daa8f1-c8"/>
Jul 25 16:51:11 user nova-compute[70659]:     </interface>
Jul 25 16:51:11 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:51:11 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/console.log" append="off"/>
Jul 25 16:51:11 user nova-compute[70659]:     </serial>
Jul 25 16:51:11 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:51:11 user nova-compute[70659]:     <video>
Jul 25 16:51:11 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:51:11 user nova-compute[70659]:     </video>
Jul 25 16:51:11 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:51:11 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:51:11 user nova-compute[70659]:     </rng>
Jul 25 16:51:11 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:51:11 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:51:11 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:51:11 user nova-compute[70659]:     </memballoon>
Jul 25 16:51:11 user nova-compute[70659]:   </devices>
Jul 25 16:51:11 user nova-compute[70659]: </domain>
Jul 25 16:51:11 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1358222157',display_name='tempest-ServersNegativeTestJSON-server-1358222157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1358222157',id=15,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a00920ce74688937a25cb3db3dd07',ramdisk_id='',reservation_id='r-3zy4ck2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1085604250',owner_user_name='tempest-ServersNegativeTestJSON-1085604250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:51:07Z,user_data=None,user_id='8c06f1babb164e4e9ae334ad5c81ab65',uuid=f3dc2e56-b192-4e05-bb09-468d85f9cf75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converting VIF {"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a8:61,bridge_name='br-int',has_traffic_filtering=True,id=73daa8f1-c8ee-437c-bf96-d17f57fa1611,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73daa8f1-c8') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG os_vif [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a8:61,bridge_name='br-int',has_traffic_filtering=True,id=73daa8f1-c8ee-437c-bf96-d17f57fa1611,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73daa8f1-c8') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73daa8f1-c8, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73daa8f1-c8, col_values=(('external_ids', {'iface-id': '73daa8f1-c8ee-437c-bf96-d17f57fa1611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:a8:61', 'vm-uuid': 'f3dc2e56-b192-4e05-bb09-468d85f9cf75'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:11 user nova-compute[70659]: INFO os_vif [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a8:61,bridge_name='br-int',has_traffic_filtering=True,id=73daa8f1-c8ee-437c-bf96-d17f57fa1611,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73daa8f1-c8')
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] No VIF found with MAC fa:16:3e:bd:a8:61, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:51:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received event network-changed-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Refreshing instance network info cache due to event network-changed-73daa8f1-c8ee-437c-bf96-d17f57fa1611. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] Acquiring lock "refresh_cache-f3dc2e56-b192-4e05-bb09-468d85f9cf75" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] Acquired lock "refresh_cache-f3dc2e56-b192-4e05-bb09-468d85f9cf75" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.network.neutron [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Refreshing network info cache for port 73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303872.486721, fc09d930-4a75-490b-a86a-08fe432d778c => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:51:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] VM Resumed (Lifecycle Event)
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:51:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Instance spawned successfully.
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303872.5472274, fc09d930-4a75-490b-a86a-08fe432d778c => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:51:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] VM Started (Lifecycle Event)
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:51:12 user nova-compute[70659]: INFO nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Took 7.10 seconds to spawn the instance on the hypervisor.
Jul 25 16:51:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:51:12 user nova-compute[70659]: INFO nova.compute.manager [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Took 8.17 seconds to build instance.
Jul 25 16:51:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7bffea25-8e54-431d-a909-5116fd73a7cb tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "fc09d930-4a75-490b-a86a-08fe432d778c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.293s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-945845e5-838a-478b-9c09-f2126d8b6a29 req-87655c1a-a424-450b-90df-ba1c545e770c service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received event network-vif-plugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-945845e5-838a-478b-9c09-f2126d8b6a29 req-87655c1a-a424-450b-90df-ba1c545e770c service nova] Acquiring lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-945845e5-838a-478b-9c09-f2126d8b6a29 req-87655c1a-a424-450b-90df-ba1c545e770c service nova] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-945845e5-838a-478b-9c09-f2126d8b6a29 req-87655c1a-a424-450b-90df-ba1c545e770c service nova] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-945845e5-838a-478b-9c09-f2126d8b6a29 req-87655c1a-a424-450b-90df-ba1c545e770c service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] No waiting events found dispatching network-vif-plugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:13 user nova-compute[70659]: WARNING nova.compute.manager [req-945845e5-838a-478b-9c09-f2126d8b6a29 req-87655c1a-a424-450b-90df-ba1c545e770c service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received unexpected event network-vif-plugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 for instance with vm_state building and task_state spawning.
Jul 25 16:51:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG nova.network.neutron [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Updated VIF entry in instance network info cache for port 73daa8f1-c8ee-437c-bf96-d17f57fa1611. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG nova.network.neutron [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Updating instance_info_cache with network_info: [{"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] Releasing lock "refresh_cache-f3dc2e56-b192-4e05-bb09-468d85f9cf75" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received event network-vif-plugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] Acquiring lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] No waiting events found dispatching network-vif-plugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:13 user nova-compute[70659]: WARNING nova.compute.manager [req-978a7ef1-dda8-48b4-9d9b-af521e860d41 req-257afe17-b945-4cac-9ad6-1ea634100a8d service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received unexpected event network-vif-plugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 for instance with vm_state building and task_state spawning.
Jul 25 16:51:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-3bc40e19-0489-4628-ab13-fd302143c13d req-7d7ed8cd-60e2-4195-8585-06de432d3bbd service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received event network-vif-plugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3bc40e19-0489-4628-ab13-fd302143c13d req-7d7ed8cd-60e2-4195-8585-06de432d3bbd service nova] Acquiring lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3bc40e19-0489-4628-ab13-fd302143c13d req-7d7ed8cd-60e2-4195-8585-06de432d3bbd service nova] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3bc40e19-0489-4628-ab13-fd302143c13d req-7d7ed8cd-60e2-4195-8585-06de432d3bbd service nova] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-3bc40e19-0489-4628-ab13-fd302143c13d req-7d7ed8cd-60e2-4195-8585-06de432d3bbd service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] No waiting events found dispatching network-vif-plugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:15 user nova-compute[70659]: WARNING nova.compute.manager [req-3bc40e19-0489-4628-ab13-fd302143c13d req-7d7ed8cd-60e2-4195-8585-06de432d3bbd service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received unexpected event network-vif-plugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 for instance with vm_state building and task_state spawning.
Jul 25 16:51:15 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303875.9144115, f3dc2e56-b192-4e05-bb09-468d85f9cf75 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:51:15 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] VM Resumed (Lifecycle Event)
Jul 25 16:51:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:51:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:51:15 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Instance spawned successfully.
Jul 25 16:51:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:51:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:16 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303875.9161887, f3dc2e56-b192-4e05-bb09-468d85f9cf75 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:51:16 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] VM Started (Lifecycle Event)
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:51:16 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:51:16 user nova-compute[70659]: INFO nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Took 9.00 seconds to spawn the instance on the hypervisor.
Jul 25 16:51:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:16 user nova-compute[70659]: INFO nova.compute.manager [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Took 10.32 seconds to build instance.
Jul 25 16:51:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2d7f758a-f619-46c8-b4a2-fac12920894b tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.547s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 16:51:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 16:51:44 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:51:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:51:44 user nova-compute[70659]: INFO nova.compute.claims [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Claim successful on node user
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:45 user nova-compute[70659]: INFO nova.compute.manager [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Detaching volume 0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae
Jul 25 16:51:45 user nova-compute[70659]: INFO nova.virt.block_device [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Attempting to driver detach volume 0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae from mountpoint /dev/vdc
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Attempting to detach device vdc from instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:51:45 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:51:45 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 16:51:45 user nova-compute[70659]:   <target dev="vdc" bus="virtio"/>
Jul 25 16:51:45 user nova-compute[70659]:   <serial>0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae</serial>
Jul 25 16:51:45 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 16:51:45 user nova-compute[70659]: </disk>
Jul 25 16:51:45 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:51:45 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully detached device vdc from instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a from the persistent domain config.
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:51:45 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:51:45 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 16:51:45 user nova-compute[70659]:   <target dev="vdc" bus="virtio"/>
Jul 25 16:51:45 user nova-compute[70659]:   <serial>0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae</serial>
Jul 25 16:51:45 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 16:51:45 user nova-compute[70659]: </disk>
Jul 25 16:51:45 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.133s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:51:45 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690303905.6391482, 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:51:45 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully detached device vdc from instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a from the live domain config.
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWvmOoFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:51:45 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91a2c15-5ea2-4935-a94b-72258bd7924d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.policy [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a55ce1dcf3eb4f7da9ce20dbc7e432c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1548931d431b4da4859656f41b33a88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee54662c-55f4-490a-b57a-9635cfada30b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:51:45 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:51:45 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:51:45 user nova-compute[70659]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:51:45 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:51:45 user nova-compute[70659]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae (non-flash)
Jul 25 16:51:45 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:51:45 user nova-compute[70659]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:51:45 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd282512d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae'): ({'sdd'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Removing single pathed devices sdd {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:51:45 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Creating image(s)
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "/opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "/opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "/opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[daecb301-d7b0-4392-a1bf-e14f9df2d476]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d953c6-d32a-4a59-92bb-497be97c29e3]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Flushing IO for device /dev/sdd {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f59ae16-43ac-4d59-b5be-5c5a9019d4c6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd44c06-d27d-4aa0-b1df-ad764df365ec]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c7b7eb-6d87-49bb-828a-b806cdb7cc69]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fd8eee-b0da-40fb-85ce-6f897f6883ed]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae, portal: 172.16.0.220,3260]
Jul 25 16:51:46 user nova-compute[70659]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae, portal: 172.16.0.220,3260] successful.
Jul 25 16:51:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.286s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6744e2-6dd1-4e3f-baa9-c6f84b4a0eae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[00839d04-7cde-48a5-8b3c-182eeae82ccd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] <== disconnect_volume: return (451ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.162s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk 1073741824" returned: 0 in 0.093s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.162s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Successfully created port: 02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Cannot resize image /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG nova.objects.instance [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lazy-loading 'migration_context' on Instance uuid 743875b3-2013-4162-9940-f1f59ca6c7f6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "6f6117f9-a000-4491-bd38-b7525298c23a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Ensure instance console log exists: /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:46 user nova-compute[70659]: INFO nova.compute.manager [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Terminating instance
Jul 25 16:51:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:51:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-7f98911b-3d8f-4b24-909c-f978d3665057 req-0e697128-1322-4cdd-93ea-f3de51493f52 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-unplugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f98911b-3d8f-4b24-909c-f978d3665057 req-0e697128-1322-4cdd-93ea-f3de51493f52 service nova] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f98911b-3d8f-4b24-909c-f978d3665057 req-0e697128-1322-4cdd-93ea-f3de51493f52 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f98911b-3d8f-4b24-909c-f978d3665057 req-0e697128-1322-4cdd-93ea-f3de51493f52 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-7f98911b-3d8f-4b24-909c-f978d3665057 req-0e697128-1322-4cdd-93ea-f3de51493f52 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] No waiting events found dispatching network-vif-unplugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-7f98911b-3d8f-4b24-909c-f978d3665057 req-0e697128-1322-4cdd-93ea-f3de51493f52 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-unplugged-31647377-15e8-4c48-a3f9-0601ae9b7493 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Instance destroyed successfully.
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.objects.instance [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'resources' on Instance uuid 6f6117f9-a000-4491-bd38-b7525298c23a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1867016362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1510861238',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdrrnEIsPtiOyPXZwZDkWWdRWRmg5eRltyImohYN5f/QNID4CDxf10xSW043jjUbCODnxMzL1McqL4p/4z9m7F1bT8oACH9CMyevg1NsoxnXEziUsCowS7fJm1RWMTB9A==',key_name='tempest-keypair-1581675553',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa87ca828941408ebb81eb439ebbc79e',ramdisk_id='',reservation_id='r-66ri7r0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510925623',owner_user_name='tempest-ServerActionsV293TestJSON-510925623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:50:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad466988c34f4e06b5c631b9754db2c5',uuid=6f6117f9-a000-4491-bd38-b7525298c23a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converting VIF {"id": "31647377-15e8-4c48-a3f9-0601ae9b7493", "address": "fa:16:3e:39:7b:c1", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31647377-15", "ovs_interfaceid": "31647377-15e8-4c48-a3f9-0601ae9b7493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_vif [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31647377-15, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Successfully updated port: 02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:51:47 user nova-compute[70659]: INFO os_vif [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:7b:c1,bridge_name='br-int',has_traffic_filtering=True,id=31647377-15e8-4c48-a3f9-0601ae9b7493,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31647377-15')
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "refresh_cache-743875b3-2013-4162-9940-f1f59ca6c7f6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquired lock "refresh_cache-743875b3-2013-4162-9940-f1f59ca6c7f6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFZiMvGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:51:47 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-04ef1c83-28fd-40f3-b105-251d58cd54a0 req-7d4dc7f0-9508-4da1-9bdc-7672136ad641 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received event network-changed-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-04ef1c83-28fd-40f3-b105-251d58cd54a0 req-7d4dc7f0-9508-4da1-9bdc-7672136ad641 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Refreshing instance network info cache due to event network-changed-02a3b00a-b9f6-4472-9186-c7db2e916cb9. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-04ef1c83-28fd-40f3-b105-251d58cd54a0 req-7d4dc7f0-9508-4da1-9bdc-7672136ad641 service nova] Acquiring lock "refresh_cache-743875b3-2013-4162-9940-f1f59ca6c7f6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a8faad-f82e-49ac-b661-efcb7895d9a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a617d9c7-a16f-4c2d-9589-da9603970e93]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:51:47 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:51:47 user nova-compute[70659]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:51:47 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:51:47 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:51:47 user nova-compute[70659]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 (non-flash)
Jul 25 16:51:47 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd282960e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252'): ({'sde'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Removing single pathed devices sde {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf4c6d2-78e6-4a11-b7f8-cbf6ef8e480f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[07921c77-f132-411e-b4c8-b13d50739883]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Flushing IO for device /dev/sde {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7c7cd-38b0-4a2b-95c2-f653949dd434]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35ce4a5-16af-4d4f-ac0f-ba86acc97c52]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:51:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6711682d-6bfb-4802-aa90-f27ddd29364d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a8b717-8ad8-4796-9413-42c06eed9cf2]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260]
Jul 25 16:51:48 user nova-compute[70659]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252, portal: 172.16.0.220,3260] successful.
Jul 25 16:51:48 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5c8d082-5cb7-44e9-b086-4de249762252 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[908279ae-a468-45b7-8684-c7c2b1331266]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] <== disconnect_volume: return (380ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:51:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Deleting instance files /opt/stack/data/nova/instances/6f6117f9-a000-4491-bd38-b7525298c23a_del
Jul 25 16:51:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Deletion of /opt/stack/data/nova/instances/6f6117f9-a000-4491-bd38-b7525298c23a_del complete
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Updating instance_info_cache with network_info: [{"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Releasing lock "refresh_cache-743875b3-2013-4162-9940-f1f59ca6c7f6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Instance network_info: |[{"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-04ef1c83-28fd-40f3-b105-251d58cd54a0 req-7d4dc7f0-9508-4da1-9bdc-7672136ad641 service nova] Acquired lock "refresh_cache-743875b3-2013-4162-9940-f1f59ca6c7f6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.network.neutron [req-04ef1c83-28fd-40f3-b105-251d58cd54a0 req-7d4dc7f0-9508-4da1-9bdc-7672136ad641 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Refreshing network info cache for port 02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Start _get_guest_xml network_info=[{"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:51:48 user nova-compute[70659]: INFO nova.compute.manager [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Took 1.51 seconds to destroy the instance on the hypervisor.
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:51:48 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-737422303',display_name='tempest-VolumesAdminNegativeTest-server-737422303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-737422303',id=16,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JYbWy8Y4uHct5MJ17ozOyQ/QzQF+XwqIfdBVDpuqw4ogKbeHe0ry5s6dn2hBwBTLu/jUP+f7dDZs0MhKkhQz0WT61NnJv65eBjqTyliYs1+AQtBL7UhPr0zGLcgim3g==',key_name='tempest-keypair-37147808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1548931d431b4da4859656f41b33a88c',ramdisk_id='',reservation_id='r-z6c2rval',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-863505829',owner_user_name='tempest-VolumesAdminNegativeTest-863505829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a55ce1dcf3eb4f7da9ce20dbc7e432c0',uuid=743875b3-2013-4162-9940-f1f59ca6c7f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converting VIF {"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:25:b1,bridge_name='br-int',has_traffic_filtering=True,id=02a3b00a-b9f6-4472-9186-c7db2e916cb9,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a3b00a-b9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.objects.instance [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lazy-loading 'pci_devices' on Instance uuid 743875b3-2013-4162-9940-f1f59ca6c7f6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:51:48 user nova-compute[70659]:   <uuid>743875b3-2013-4162-9940-f1f59ca6c7f6</uuid>
Jul 25 16:51:48 user nova-compute[70659]:   <name>instance-00000010</name>
Jul 25 16:51:48 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:51:48 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:51:48 user nova-compute[70659]:   <metadata>
Jul 25 16:51:48 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:51:48 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:51:48 user nova-compute[70659]:       <nova:name>tempest-VolumesAdminNegativeTest-server-737422303</nova:name>
Jul 25 16:51:48 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:51:48</nova:creationTime>
Jul 25 16:51:48 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:51:48 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:51:48 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:51:48 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:51:48 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:51:48 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:51:48 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:51:48 user nova-compute[70659]:       <nova:owner>
Jul 25 16:51:48 user nova-compute[70659]:         <nova:user uuid="a55ce1dcf3eb4f7da9ce20dbc7e432c0">tempest-VolumesAdminNegativeTest-863505829-project-member</nova:user>
Jul 25 16:51:48 user nova-compute[70659]:         <nova:project uuid="1548931d431b4da4859656f41b33a88c">tempest-VolumesAdminNegativeTest-863505829</nova:project>
Jul 25 16:51:48 user nova-compute[70659]:       </nova:owner>
Jul 25 16:51:48 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:51:48 user nova-compute[70659]:       <nova:ports>
Jul 25 16:51:48 user nova-compute[70659]:         <nova:port uuid="02a3b00a-b9f6-4472-9186-c7db2e916cb9">
Jul 25 16:51:48 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 16:51:48 user nova-compute[70659]:         </nova:port>
Jul 25 16:51:48 user nova-compute[70659]:       </nova:ports>
Jul 25 16:51:48 user nova-compute[70659]:     </nova:instance>
Jul 25 16:51:48 user nova-compute[70659]:   </metadata>
Jul 25 16:51:48 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:51:48 user nova-compute[70659]:     <system>
Jul 25 16:51:48 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:51:48 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:51:48 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:51:48 user nova-compute[70659]:       <entry name="serial">743875b3-2013-4162-9940-f1f59ca6c7f6</entry>
Jul 25 16:51:48 user nova-compute[70659]:       <entry name="uuid">743875b3-2013-4162-9940-f1f59ca6c7f6</entry>
Jul 25 16:51:48 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:51:48 user nova-compute[70659]:     </system>
Jul 25 16:51:48 user nova-compute[70659]:   </sysinfo>
Jul 25 16:51:48 user nova-compute[70659]:   <os>
Jul 25 16:51:48 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:51:48 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:51:48 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:51:48 user nova-compute[70659]:   </os>
Jul 25 16:51:48 user nova-compute[70659]:   <features>
Jul 25 16:51:48 user nova-compute[70659]:     <acpi/>
Jul 25 16:51:48 user nova-compute[70659]:     <apic/>
Jul 25 16:51:48 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:51:48 user nova-compute[70659]:   </features>
Jul 25 16:51:48 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:51:48 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:51:48 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:51:48 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:51:48 user nova-compute[70659]:   </clock>
Jul 25 16:51:48 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:51:48 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:51:48 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:51:48 user nova-compute[70659]:   </cpu>
Jul 25 16:51:48 user nova-compute[70659]:   <devices>
Jul 25 16:51:48 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:51:48 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:51:48 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk"/>
Jul 25 16:51:48 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:51:48 user nova-compute[70659]:     </disk>
Jul 25 16:51:48 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:51:48 user nova-compute[70659]:       <mac address="fa:16:3e:4e:25:b1"/>
Jul 25 16:51:48 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:51:48 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:51:48 user nova-compute[70659]:       <target dev="tap02a3b00a-b9"/>
Jul 25 16:51:48 user nova-compute[70659]:     </interface>
Jul 25 16:51:48 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:51:48 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/console.log" append="off"/>
Jul 25 16:51:48 user nova-compute[70659]:     </serial>
Jul 25 16:51:48 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:51:48 user nova-compute[70659]:     <video>
Jul 25 16:51:48 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:51:48 user nova-compute[70659]:     </video>
Jul 25 16:51:48 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:51:48 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:51:48 user nova-compute[70659]:     </rng>
Jul 25 16:51:48 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:51:48 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:51:48 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:51:48 user nova-compute[70659]:     </memballoon>
Jul 25 16:51:48 user nova-compute[70659]:   </devices>
Jul 25 16:51:48 user nova-compute[70659]: </domain>
Jul 25 16:51:48 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-737422303',display_name='tempest-VolumesAdminNegativeTest-server-737422303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-737422303',id=16,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JYbWy8Y4uHct5MJ17ozOyQ/QzQF+XwqIfdBVDpuqw4ogKbeHe0ry5s6dn2hBwBTLu/jUP+f7dDZs0MhKkhQz0WT61NnJv65eBjqTyliYs1+AQtBL7UhPr0zGLcgim3g==',key_name='tempest-keypair-37147808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1548931d431b4da4859656f41b33a88c',ramdisk_id='',reservation_id='r-z6c2rval',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-863505829',owner_user_name='tempest-VolumesAdminNegativeTest-863505829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a55ce1dcf3eb4f7da9ce20dbc7e432c0',uuid=743875b3-2013-4162-9940-f1f59ca6c7f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converting VIF {"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:25:b1,bridge_name='br-int',has_traffic_filtering=True,id=02a3b00a-b9f6-4472-9186-c7db2e916cb9,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a3b00a-b9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG os_vif [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:25:b1,bridge_name='br-int',has_traffic_filtering=True,id=02a3b00a-b9f6-4472-9186-c7db2e916cb9,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a3b00a-b9') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02a3b00a-b9, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02a3b00a-b9, col_values=(('external_ids', {'iface-id': '02a3b00a-b9f6-4472-9186-c7db2e916cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:25:b1', 'vm-uuid': '743875b3-2013-4162-9940-f1f59ca6c7f6'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:48 user nova-compute[70659]: INFO os_vif [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:25:b1,bridge_name='br-int',has_traffic_filtering=True,id=02a3b00a-b9f6-4472-9186-c7db2e916cb9,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a3b00a-b9')
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] No VIF found with MAC fa:16:3e:4e:25:b1, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.network.neutron [req-04ef1c83-28fd-40f3-b105-251d58cd54a0 req-7d4dc7f0-9508-4da1-9bdc-7672136ad641 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Updated VIF entry in instance network info cache for port 02a3b00a-b9f6-4472-9186-c7db2e916cb9. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG nova.network.neutron [req-04ef1c83-28fd-40f3-b105-251d58cd54a0 req-7d4dc7f0-9508-4da1-9bdc-7672136ad641 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Updating instance_info_cache with network_info: [{"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-04ef1c83-28fd-40f3-b105-251d58cd54a0 req-7d4dc7f0-9508-4da1-9bdc-7672136ad641 service nova] Releasing lock "refresh_cache-743875b3-2013-4162-9940-f1f59ca6c7f6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Error from libvirt while getting description of instance-0000000d: [Error Code 42] Domain not found: no domain with matching uuid '6f6117f9-a000-4491-bd38-b7525298c23a' (instance-0000000d): libvirt.libvirtError: Domain not found: no domain with matching uuid '6f6117f9-a000-4491-bd38-b7525298c23a' (instance-0000000d)
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-e004340d-7539-4605-9991-4cdd9b10c4cd req-7d71724e-ddbe-4b28-bfa1-e8c0ac264ee6 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-deleted-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:49 user nova-compute[70659]: INFO nova.compute.manager [req-e004340d-7539-4605-9991-4cdd9b10c4cd req-7d71724e-ddbe-4b28-bfa1-e8c0ac264ee6 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Neutron deleted interface 31647377-15e8-4c48-a3f9-0601ae9b7493; detaching it from the instance and deleting it from the info cache
Jul 25 16:51:49 user nova-compute[70659]: DEBUG nova.network.neutron [req-e004340d-7539-4605-9991-4cdd9b10c4cd req-7d71724e-ddbe-4b28-bfa1-e8c0ac264ee6 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:49 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Took 0.91 seconds to deallocate network for instance.
Jul 25 16:51:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-e004340d-7539-4605-9991-4cdd9b10c4cd req-7d71724e-ddbe-4b28-bfa1-e8c0ac264ee6 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Detach interface failed, port_id=31647377-15e8-4c48-a3f9-0601ae9b7493, reason: Instance 6f6117f9-a000-4491-bd38-b7525298c23a could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-580725f6-bb6b-4dd7-9af4-4aacc3294ae1 req-5b13c393-859d-4535-afd4-23eec518b912 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-580725f6-bb6b-4dd7-9af4-4aacc3294ae1 req-5b13c393-859d-4535-afd4-23eec518b912 service nova] Acquiring lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-580725f6-bb6b-4dd7-9af4-4aacc3294ae1 req-5b13c393-859d-4535-afd4-23eec518b912 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-580725f6-bb6b-4dd7-9af4-4aacc3294ae1 req-5b13c393-859d-4535-afd4-23eec518b912 service nova] Lock "6f6117f9-a000-4491-bd38-b7525298c23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-580725f6-bb6b-4dd7-9af4-4aacc3294ae1 req-5b13c393-859d-4535-afd4-23eec518b912 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] No waiting events found dispatching network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:49 user nova-compute[70659]: WARNING nova.compute.manager [req-580725f6-bb6b-4dd7-9af4-4aacc3294ae1 req-5b13c393-859d-4535-afd4-23eec518b912 service nova] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Received unexpected event network-vif-plugged-31647377-15e8-4c48-a3f9-0601ae9b7493 for instance with vm_state active and task_state deleting.
Jul 25 16:51:49 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'flavor' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:49 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:51:49 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:51:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7232MB free_disk=25.507205963134766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fe4feba8-6662-4ea9-a57e-ff03a9ad1549 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.824s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Applying migration context for instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e as it has an incoming, in-progress migration 882997f6-8615-4f80-a72b-4f8c33f47863. Migration status is finished {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 16:51:50 user nova-compute[70659]: INFO nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating resource usage from migration 882997f6-8615-4f80-a72b-4f8c33f47863
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c9728d00-f454-4616-af0b-8cfd0f012cad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 6f6117f9-a000-4491-bd38-b7525298c23a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Migration 882997f6-8615-4f80-a72b-4f8c33f47863 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 743875b3-2013-4162-9940-f1f59ca6c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:51:50 user nova-compute[70659]: INFO nova.compute.manager [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Took 0.96 seconds to detach 1 volumes for instance.
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Deleting volume: b5c8d082-5cb7-44e9-b086-4de249762252 {{(pid=70659) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-e3265ee9-ae7b-44af-a0f9-d527b6f54ab9 req-6d372690-74d6-4a62-8a27-d780eb216adc service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received event network-vif-plugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e3265ee9-ae7b-44af-a0f9-d527b6f54ab9 req-6d372690-74d6-4a62-8a27-d780eb216adc service nova] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e3265ee9-ae7b-44af-a0f9-d527b6f54ab9 req-6d372690-74d6-4a62-8a27-d780eb216adc service nova] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e3265ee9-ae7b-44af-a0f9-d527b6f54ab9 req-6d372690-74d6-4a62-8a27-d780eb216adc service nova] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-e3265ee9-ae7b-44af-a0f9-d527b6f54ab9 req-6d372690-74d6-4a62-8a27-d780eb216adc service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] No waiting events found dispatching network-vif-plugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:50 user nova-compute[70659]: WARNING nova.compute.manager [req-e3265ee9-ae7b-44af-a0f9-d527b6f54ab9 req-6d372690-74d6-4a62-8a27-d780eb216adc service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received unexpected event network-vif-plugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 for instance with vm_state building and task_state spawning.
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.349s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:51:50 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:51:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:51 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Deleted allocations for instance 6f6117f9-a000-4491-bd38-b7525298c23a
Jul 25 16:51:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-207b44f2-49b3-4d88-bcca-c7a19fee3f58 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "6f6117f9-a000-4491-bd38-b7525298c23a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.459s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:51:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:51:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:51:51 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-d4404d06-6429-4bd8-8833-7b02728bce80 req-aa877be7-56ee-4114-8630-42b8011a90d7 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received event network-vif-plugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4404d06-6429-4bd8-8833-7b02728bce80 req-aa877be7-56ee-4114-8630-42b8011a90d7 service nova] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4404d06-6429-4bd8-8833-7b02728bce80 req-aa877be7-56ee-4114-8630-42b8011a90d7 service nova] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4404d06-6429-4bd8-8833-7b02728bce80 req-aa877be7-56ee-4114-8630-42b8011a90d7 service nova] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-d4404d06-6429-4bd8-8833-7b02728bce80 req-aa877be7-56ee-4114-8630-42b8011a90d7 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] No waiting events found dispatching network-vif-plugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:52 user nova-compute[70659]: WARNING nova.compute.manager [req-d4404d06-6429-4bd8-8833-7b02728bce80 req-aa877be7-56ee-4114-8630-42b8011a90d7 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received unexpected event network-vif-plugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 for instance with vm_state building and task_state spawning.
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303912.3772035, 743875b3-2013-4162-9940-f1f59ca6c7f6 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:51:52 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] VM Resumed (Lifecycle Event)
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:51:52 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Instance spawned successfully.
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:51:52 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303912.3793173, 743875b3-2013-4162-9940-f1f59ca6c7f6 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:51:52 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] VM Started (Lifecycle Event)
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.network.neutron [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Port 8f746e90-8b94-4b8c-8c13-02df5983ced0 binding to destination host user is already ACTIVE {{(pid=70659) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquired lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.network.neutron [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:51:52 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:51:52 user nova-compute[70659]: INFO nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Took 6.77 seconds to spawn the instance on the hypervisor.
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating instance_info_cache with network_info: [{"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:51:52 user nova-compute[70659]: INFO nova.compute.manager [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Took 7.74 seconds to build instance.
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e08108b7-07de-4c5b-991c-f94d1c80ca30 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.849s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG nova.network.neutron [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance_info_cache with network_info: [{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Releasing lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Creating tmpfile /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/tmpm1h4jav2 to verify with other compute node that the instance is on the same shared storage. {{(pid=70659) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance destroyed successfully.
Jul 25 16:51:53 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'resources' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1071496954',display_name='tempest-ServerActionsTestOtherB-server-1071496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1071496954',id=7,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWJlFb4j8Ys1CPB/bDiS40Ugcuw2Q/xoj3AvPfDyBBFFTZke2FjMd2/DfM6CM24MZfC34jM3nOUoDm3L0rcAn9FD/4h8gEUHn4G9Y2qb8q+bjHLww9szHUFjYPz7u30g==',key_name='tempest-keypair-329454245',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:50:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb25024c830544d682f76d9dc10171e2',ramdisk_id='',reservation_id='r-y1z79cx8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1921270631',owner_user_name='tempest-ServerActionsTestOtherB-1921270631-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ebfb3f4c65f4e16be5234a8a4e99e3c',uuid=5192b767-96f0-4789-ac74-0d6d6b5bef3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converting VIF {"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG os_vif [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f746e90-8b, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:51:53 user nova-compute[70659]: INFO os_vif [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b')
Jul 25 16:51:53 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:51:53 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:51:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ebf656-0529-4ec6-a6bd-f1e2b847f6dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67b927b-40b5-4ba6-869e-ca1cc78a2616]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:51:54 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:51:54 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:51:54 user nova-compute[70659]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:51:54 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd303a2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'): ({'sdc'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Removing single pathed devices sdc {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd1a6c7-ff3a-4091-8188-a030ac17c053]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e58a55-7a6f-45fd-baa0-189a7537d412]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Flushing IO for device /dev/sdc {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaa64c3-9541-45e5-b045-fe31d558a0ed]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d26539-9c66-4b0f-aaa8-e84812033a56]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[05181ac0-117a-4368-8c8d-f214909beb34]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3caaa8-05cc-4d7e-a5d4-3f7c0083a5af]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]
Jul 25 16:51:54 user nova-compute[70659]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.
Jul 25 16:51:54 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c66b1a-d843-4b56-88d2-aa40f98ed0d7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] <== disconnect_volume: return (294ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-unplugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-unplugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:54 user nova-compute[70659]: WARNING nova.compute.manager [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-unplugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state resized and task_state resize_reverting.
Jul 25 16:51:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:54 user nova-compute[70659]: WARNING nova.compute.manager [req-f5c6b819-6124-4722-af96-875e14af12d6 req-0485c4b6-61b0-4afd-ae3f-320e5873a58b service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state resized and task_state resize_reverting.
Jul 25 16:51:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:55 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'migration_context' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:55 user nova-compute[70659]: INFO nova.compute.manager [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Detaching volume 142da0f9-710e-45ac-aef3-6ca961bb6c6d
Jul 25 16:51:55 user nova-compute[70659]: INFO nova.virt.block_device [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Attempting to driver detach volume 142da0f9-710e-45ac-aef3-6ca961bb6c6d from mountpoint /dev/vdb
Jul 25 16:51:55 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:51:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Attempting to detach device vdb from instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:51:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:51:55 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:51:55 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:51:55 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:51:55 user nova-compute[70659]:   <serial>142da0f9-710e-45ac-aef3-6ca961bb6c6d</serial>
Jul 25 16:51:55 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 16:51:55 user nova-compute[70659]: </disk>
Jul 25 16:51:55 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:51:55 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:51:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully detached device vdb from instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 from the persistent domain config.
Jul 25 16:51:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:51:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:51:55 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:51:55 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:51:55 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:51:55 user nova-compute[70659]:   <serial>142da0f9-710e-45ac-aef3-6ca961bb6c6d</serial>
Jul 25 16:51:55 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 16:51:55 user nova-compute[70659]: </disk>
Jul 25 16:51:55 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:51:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.644s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690303916.2844386, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:51:56 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully detached device vdb from instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 from the live domain config.
Jul 25 16:51:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gizvkWxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:51:56 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0fa696-7c32-4b02-a106-7bb71201a96b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[26958c96-0bc5-4d1d-86a1-ac91a2cbcb94]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:51:56 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d (non-flash)
Jul 25 16:51:56 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd3021d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[98984751-3f09-483d-9b0f-f2241e08b556]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:56 user nova-compute[70659]: INFO nova.compute.manager [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Swapping old allocation on dict_keys(['9f90033f-5d23-4363-83e3-e56f7852cf56']) held by migration 882997f6-8615-4f80-a72b-4f8c33f47863 for instance
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a473a39b-8ed9-48dc-bedd-9a04bad26663]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[556edbe0-0768-443d-9b0c-09a3829ae35b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd26042-7fba-443e-bb7a-86d6a0365486]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Overwriting current allocation {'allocations': {'9f90033f-5d23-4363-83e3-e56f7852cf56': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': 'eb25024c830544d682f76d9dc10171e2', 'user_id': '1ebfb3f4c65f4e16be5234a8a4e99e3c', 'consumer_generation': 1} on consumer 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9971c66b-1552-49d9-8c7e-f3f3518ac055]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b754e3d5-b874-48e1-b4d3-2962d0ff13db]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260]
Jul 25 16:51:56 user nova-compute[70659]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d, portal: 172.16.0.220,3260] successful.
Jul 25 16:51:56 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:142da0f9-710e-45ac-aef3-6ca961bb6c6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d69c4a2-90de-4cc8-b80e-d9617ac80206]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== disconnect_volume: return (298ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquired lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:51:56 user nova-compute[70659]: DEBUG nova.network.neutron [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2c51ec0f-a350-4cfb-99a1-36d71fce640c tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.883s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG nova.network.neutron [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance_info_cache with network_info: [{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Releasing lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG os_brick.utils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e37542d-24d9-4280-b57a-dc9012804022]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc728452-afb8-4d32-9e36-e4b5f6302dd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5789f37-8a1d-4e29-a615-63acaf4dda8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e60e3d8-98d2-4794-8272-da5a8be5fefa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:51:57 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf840c7-561b-43bf-bf1d-d1b09ab628cf]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG os_brick.utils [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-79962f6c-4fa6-43a9-b6c3-f998edacf491 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-79962f6c-4fa6-43a9-b6c3-f998edacf491 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-79962f6c-4fa6-43a9-b6c3-f998edacf491 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-79962f6c-4fa6-43a9-b6c3-f998edacf491 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70659) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 25 16:51:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-79962f6c-4fa6-43a9-b6c3-f998edacf491 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG nova.compute.manager [req-24365908-9f3d-4e7e-947e-46b2c1dc7f13 req-827be842-061a-4047-91b4-d003e11047d5 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-unplugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-24365908-9f3d-4e7e-947e-46b2c1dc7f13 req-827be842-061a-4047-91b4-d003e11047d5 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-24365908-9f3d-4e7e-947e-46b2c1dc7f13 req-827be842-061a-4047-91b4-d003e11047d5 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-24365908-9f3d-4e7e-947e-46b2c1dc7f13 req-827be842-061a-4047-91b4-d003e11047d5 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG nova.compute.manager [req-24365908-9f3d-4e7e-947e-46b2c1dc7f13 req-827be842-061a-4047-91b4-d003e11047d5 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-unplugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:51:58 user nova-compute[70659]: WARNING nova.compute.manager [req-24365908-9f3d-4e7e-947e-46b2c1dc7f13 req-827be842-061a-4047-91b4-d003e11047d5 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-unplugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state active and task_state powering-off.
Jul 25 16:51:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:51:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance destroyed successfully.
Jul 25 16:51:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-79962f6c-4fa6-43a9-b6c3-f998edacf491 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-79962f6c-4fa6-43a9-b6c3-f998edacf491 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.935s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:51:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-6e23ad88-8787-4840-aa20-e947062a45cd req-c95f8b9e-914a-40ee-b1a7-fcf428411193 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6e23ad88-8787-4840-aa20-e947062a45cd req-c95f8b9e-914a-40ee-b1a7-fcf428411193 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6e23ad88-8787-4840-aa20-e947062a45cd req-c95f8b9e-914a-40ee-b1a7-fcf428411193 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6e23ad88-8787-4840-aa20-e947062a45cd req-c95f8b9e-914a-40ee-b1a7-fcf428411193 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-6e23ad88-8787-4840-aa20-e947062a45cd req-c95f8b9e-914a-40ee-b1a7-fcf428411193 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:00 user nova-compute[70659]: WARNING nova.compute.manager [req-6e23ad88-8787-4840-aa20-e947062a45cd req-c95f8b9e-914a-40ee-b1a7-fcf428411193 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state stopped and task_state None.
Jul 25 16:52:02 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303907.5860715, 6f6117f9-a000-4491-bd38-b7525298c23a => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:02 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] VM Stopped (Lifecycle Event)
Jul 25 16:52:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-aaa48ed6-23ca-49d8-aabd-94c43585e8b2 None None] [instance: 6f6117f9-a000-4491-bd38-b7525298c23a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Starting finish_revert_migration {{(pid=70659) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Start _get_guest_xml network_info=[{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ac5282d9-8f76-4672-9c7d-4b50898f521e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5192b767-96f0-4789-ac74-0d6d6b5bef3e', 'attached_at': '2023-07-25T16:52:05.000000', 'detached_at': '', 'volume_id': 'a42f574e-bafc-4e90-9fc2-f92970561add', 'serial': 'a42f574e-bafc-4e90-9fc2-f92970561add'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:52:04 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:52:04 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:52:04 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:52:04 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:52:04 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b1282-ce45-49b8-8dbf-bdd82ecb5746]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:52:04 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5e0690-db76-4854-bbf5-75e094ed280f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add] added
Jul 25 16:52:04 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe05ce9-ce14-424e-bbb2-4ce3ac893086]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f23d1de-7e35-4e39-8ac6-4211e9f8a948]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgFjEUbd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgFjEUbd" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b22a27-59fa-4f36-a118-1f1eb2058bec]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgFjEUbd'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0278cb3-adaa-481a-ad18-a67e7815542c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:52:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c60237a-23b3-4d8d-9945-35cd724482c1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:52:05 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:52:05 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:52:05 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 16:52:05 user nova-compute[70659]: 
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd2c4bd-093e-416d-b783-0d1cd72ec7c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]
Jul 25 16:52:05 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.
Jul 25 16:52:05 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb601d28-3046-43ca-8981-69eca3d53f15]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[77200d5d-4c01-4e22-acab-b637e0bab74b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:52:05 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:52:05 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93418ec-f55a-488d-8bdf-708fee7e95ef]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:52:05 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23866653066636166', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866653066636166', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1071496954',display_name='tempest-ServerActionsTestOtherB-server-1071496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1071496954',id=7,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWJlFb4j8Ys1CPB/bDiS40Ugcuw2Q/xoj3AvPfDyBBFFTZke2FjMd2/DfM6CM24MZfC34jM3nOUoDm3L0rcAn9FD/4h8gEUHn4G9Y2qb8q+bjHLww9szHUFjYPz7u30g==',key_name='tempest-keypair-329454245',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:50:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb25024c830544d682f76d9dc10171e2',ramdisk_id='',reservation_id='r-y1z79cx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1921270631',owner_user_name='tempest-ServerActionsTestOtherB-1921270631-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ebfb3f4c65f4e16be5234a8a4e99e3c',uuid=5192b767-96f0-4789-ac74-0d6d6b5bef3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converting VIF {"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:52:06 user nova-compute[70659]:   <uuid>5192b767-96f0-4789-ac74-0d6d6b5bef3e</uuid>
Jul 25 16:52:06 user nova-compute[70659]:   <name>instance-00000007</name>
Jul 25 16:52:06 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:52:06 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:52:06 user nova-compute[70659]:   <metadata>
Jul 25 16:52:06 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:52:06 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:52:06 user nova-compute[70659]:       <nova:name>tempest-ServerActionsTestOtherB-server-1071496954</nova:name>
Jul 25 16:52:06 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:52:04</nova:creationTime>
Jul 25 16:52:06 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:52:06 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:52:06 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:52:06 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:52:06 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:52:06 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:52:06 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:52:06 user nova-compute[70659]:       <nova:owner>
Jul 25 16:52:06 user nova-compute[70659]:         <nova:user uuid="1ebfb3f4c65f4e16be5234a8a4e99e3c">tempest-ServerActionsTestOtherB-1921270631-project-member</nova:user>
Jul 25 16:52:06 user nova-compute[70659]:         <nova:project uuid="eb25024c830544d682f76d9dc10171e2">tempest-ServerActionsTestOtherB-1921270631</nova:project>
Jul 25 16:52:06 user nova-compute[70659]:       </nova:owner>
Jul 25 16:52:06 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:52:06 user nova-compute[70659]:       <nova:ports>
Jul 25 16:52:06 user nova-compute[70659]:         <nova:port uuid="8f746e90-8b94-4b8c-8c13-02df5983ced0">
Jul 25 16:52:06 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 16:52:06 user nova-compute[70659]:         </nova:port>
Jul 25 16:52:06 user nova-compute[70659]:       </nova:ports>
Jul 25 16:52:06 user nova-compute[70659]:     </nova:instance>
Jul 25 16:52:06 user nova-compute[70659]:   </metadata>
Jul 25 16:52:06 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:52:06 user nova-compute[70659]:     <system>
Jul 25 16:52:06 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:52:06 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:52:06 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:52:06 user nova-compute[70659]:       <entry name="serial">5192b767-96f0-4789-ac74-0d6d6b5bef3e</entry>
Jul 25 16:52:06 user nova-compute[70659]:       <entry name="uuid">5192b767-96f0-4789-ac74-0d6d6b5bef3e</entry>
Jul 25 16:52:06 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:52:06 user nova-compute[70659]:     </system>
Jul 25 16:52:06 user nova-compute[70659]:   </sysinfo>
Jul 25 16:52:06 user nova-compute[70659]:   <os>
Jul 25 16:52:06 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:52:06 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:52:06 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:52:06 user nova-compute[70659]:   </os>
Jul 25 16:52:06 user nova-compute[70659]:   <features>
Jul 25 16:52:06 user nova-compute[70659]:     <acpi/>
Jul 25 16:52:06 user nova-compute[70659]:     <apic/>
Jul 25 16:52:06 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:52:06 user nova-compute[70659]:   </features>
Jul 25 16:52:06 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:52:06 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:52:06 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:52:06 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:52:06 user nova-compute[70659]:   </clock>
Jul 25 16:52:06 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:52:06 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:52:06 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:52:06 user nova-compute[70659]:   </cpu>
Jul 25 16:52:06 user nova-compute[70659]:   <devices>
Jul 25 16:52:06 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:52:06 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:52:06 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk"/>
Jul 25 16:52:06 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:52:06 user nova-compute[70659]:     </disk>
Jul 25 16:52:06 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:52:06 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:52:06 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 16:52:06 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 16:52:06 user nova-compute[70659]:       <serial>a42f574e-bafc-4e90-9fc2-f92970561add</serial>
Jul 25 16:52:06 user nova-compute[70659]:     </disk>
Jul 25 16:52:06 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:52:06 user nova-compute[70659]:       <mac address="fa:16:3e:3b:ca:b5"/>
Jul 25 16:52:06 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:52:06 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:52:06 user nova-compute[70659]:       <target dev="tap8f746e90-8b"/>
Jul 25 16:52:06 user nova-compute[70659]:     </interface>
Jul 25 16:52:06 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:52:06 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/console.log" append="off"/>
Jul 25 16:52:06 user nova-compute[70659]:     </serial>
Jul 25 16:52:06 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:52:06 user nova-compute[70659]:     <video>
Jul 25 16:52:06 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:52:06 user nova-compute[70659]:     </video>
Jul 25 16:52:06 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:52:06 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:52:06 user nova-compute[70659]:     </rng>
Jul 25 16:52:06 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:52:06 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:52:06 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:52:06 user nova-compute[70659]:     </memballoon>
Jul 25 16:52:06 user nova-compute[70659]:   </devices>
Jul 25 16:52:06 user nova-compute[70659]: </domain>
Jul 25 16:52:06 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1071496954',display_name='tempest-ServerActionsTestOtherB-server-1071496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1071496954',id=7,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWJlFb4j8Ys1CPB/bDiS40Ugcuw2Q/xoj3AvPfDyBBFFTZke2FjMd2/DfM6CM24MZfC34jM3nOUoDm3L0rcAn9FD/4h8gEUHn4G9Y2qb8q+bjHLww9szHUFjYPz7u30g==',key_name='tempest-keypair-329454245',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:50:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb25024c830544d682f76d9dc10171e2',ramdisk_id='',reservation_id='r-y1z79cx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1921270631',owner_user_name='tempest-ServerActionsTestOtherB-1921270631-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ebfb3f4c65f4e16be5234a8a4e99e3c',uuid=5192b767-96f0-4789-ac74-0d6d6b5bef3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converting VIF {"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG os_vif [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f746e90-8b, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f746e90-8b, col_values=(('external_ids', {'iface-id': '8f746e90-8b94-4b8c-8c13-02df5983ced0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ca:b5', 'vm-uuid': '5192b767-96f0-4789-ac74-0d6d6b5bef3e'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:06 user nova-compute[70659]: INFO os_vif [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b')
Jul 25 16:52:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-4ec43c8a-3eb2-48af-ad48-ef26f18b6865 req-79e5334f-4785-433d-9da3-ce01d4c7a558 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4ec43c8a-3eb2-48af-ad48-ef26f18b6865 req-79e5334f-4785-433d-9da3-ce01d4c7a558 service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4ec43c8a-3eb2-48af-ad48-ef26f18b6865 req-79e5334f-4785-433d-9da3-ce01d4c7a558 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4ec43c8a-3eb2-48af-ad48-ef26f18b6865 req-79e5334f-4785-433d-9da3-ce01d4c7a558 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-4ec43c8a-3eb2-48af-ad48-ef26f18b6865 req-79e5334f-4785-433d-9da3-ce01d4c7a558 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:07 user nova-compute[70659]: WARNING nova.compute.manager [req-4ec43c8a-3eb2-48af-ad48-ef26f18b6865 req-79e5334f-4785-433d-9da3-ce01d4c7a558 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state resized and task_state resize_reverting.
Jul 25 16:52:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:08 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303913.9261584, 5192b767-96f0-4789-ac74-0d6d6b5bef3e => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:08 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] VM Stopped (Lifecycle Event)
Jul 25 16:52:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6c54ea14-6951-429a-88c6-6174239463c4 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:09 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303929.9800897, 5192b767-96f0-4789-ac74-0d6d6b5bef3e => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:09 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] VM Resumed (Lifecycle Event)
Jul 25 16:52:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:52:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance running successfully.
Jul 25 16:52:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] finish_revert_migration finished successfully. {{(pid=70659) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 25 16:52:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-1d85fe20-efae-413b-97d2-63726a63365e req-7d9bef9b-07b0-486c-90fc-aa45730463ad service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1d85fe20-efae-413b-97d2-63726a63365e req-7d9bef9b-07b0-486c-90fc-aa45730463ad service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1d85fe20-efae-413b-97d2-63726a63365e req-7d9bef9b-07b0-486c-90fc-aa45730463ad service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1d85fe20-efae-413b-97d2-63726a63365e req-7d9bef9b-07b0-486c-90fc-aa45730463ad service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-1d85fe20-efae-413b-97d2-63726a63365e req-7d9bef9b-07b0-486c-90fc-aa45730463ad service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:10 user nova-compute[70659]: WARNING nova.compute.manager [req-1d85fe20-efae-413b-97d2-63726a63365e req-7d9bef9b-07b0-486c-90fc-aa45730463ad service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state resized and task_state resize_reverting.
Jul 25 16:52:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:52:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 25 16:52:10 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303929.9827337, 5192b767-96f0-4789-ac74-0d6d6b5bef3e => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] VM Started (Lifecycle Event)
Jul 25 16:52:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:52:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 25 16:52:10 user nova-compute[70659]: INFO nova.compute.manager [None req-311b2f57-f0df-4c94-8b2c-35b32522e491 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance to original state: 'active'
Jul 25 16:52:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:13 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303918.8419206, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:13 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] VM Stopped (Lifecycle Event)
Jul 25 16:52:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b0ed0420-f32f-4318-bfdc-3c68c7cc91c1 None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b0ed0420-f32f-4318-bfdc-3c68c7cc91c1 None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:52:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid c9728d00-f454-4616-af0b-8cfd0f012cad {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid fc09d930-4a75-490b-a86a-08fe432d778c {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid f3dc2e56-b192-4e05-bb09-468d85f9cf75 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 743875b3-2013-4162-9940-f1f59ca6c7f6 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "c9728d00-f454-4616-af0b-8cfd0f012cad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "fc09d930-4a75-490b-a86a-08fe432d778c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "fc09d930-4a75-490b-a86a-08fe432d778c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "fc09d930-4a75-490b-a86a-08fe432d778c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:34 user nova-compute[70659]: INFO nova.compute.manager [None req-0e7a5b8a-0155-44d7-b673-e492ea61c471 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Unrescuing
Jul 25 16:52:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e7a5b8a-0155-44d7-b673-e492ea61c471 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:52:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e7a5b8a-0155-44d7-b673-e492ea61c471 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquired lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:52:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0e7a5b8a-0155-44d7-b673-e492ea61c471 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:52:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0e7a5b8a-0155-44d7-b673-e492ea61c471 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updating instance_info_cache with network_info: [{"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:52:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e7a5b8a-0155-44d7-b673-e492ea61c471 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Releasing lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:52:34 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0e7a5b8a-0155-44d7-b673-e492ea61c471 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'flavor' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:52:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-cbb919fb-14a8-4470-9124-3360c6247cbb req-c0cb103c-e160-4fd2-9587-c403befd2bd2 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cbb919fb-14a8-4470-9124-3360c6247cbb req-c0cb103c-e160-4fd2-9587-c403befd2bd2 service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cbb919fb-14a8-4470-9124-3360c6247cbb req-c0cb103c-e160-4fd2-9587-c403befd2bd2 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cbb919fb-14a8-4470-9124-3360c6247cbb req-c0cb103c-e160-4fd2-9587-c403befd2bd2 service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-cbb919fb-14a8-4470-9124-3360c6247cbb req-c0cb103c-e160-4fd2-9587-c403befd2bd2 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:35 user nova-compute[70659]: WARNING nova.compute.manager [req-cbb919fb-14a8-4470-9124-3360c6247cbb req-c0cb103c-e160-4fd2-9587-c403befd2bd2 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:52:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:35 user nova-compute[70659]: INFO nova.compute.manager [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Terminating instance
Jul 25 16:52:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Instance destroyed successfully.
Jul 25 16:52:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-50ac9d1d-3959-4b49-8b25-6948236e5eab req-aa5c92a0-7eb3-4100-9494-44debfda9a06 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-unplugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50ac9d1d-3959-4b49-8b25-6948236e5eab req-aa5c92a0-7eb3-4100-9494-44debfda9a06 service nova] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50ac9d1d-3959-4b49-8b25-6948236e5eab req-aa5c92a0-7eb3-4100-9494-44debfda9a06 service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50ac9d1d-3959-4b49-8b25-6948236e5eab req-aa5c92a0-7eb3-4100-9494-44debfda9a06 service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-50ac9d1d-3959-4b49-8b25-6948236e5eab req-aa5c92a0-7eb3-4100-9494-44debfda9a06 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] No waiting events found dispatching network-vif-unplugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-50ac9d1d-3959-4b49-8b25-6948236e5eab req-aa5c92a0-7eb3-4100-9494-44debfda9a06 service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-unplugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Instance destroyed successfully.
Jul 25 16:52:36 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'resources' on Instance uuid 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-905791245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-905791245',id=6,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOymDjzlIsiz32bRLLU6vehbllh7+WKErUo8ql1bWnzAC3zORdhGDdr8wCoOVTjNchVn98dkc5ViScdVeOVpOsKe6iiUnM/m0wVkj/O7mSoMFcB+Dbqwp/I0fkYoPqM7xA==',key_name='tempest-keypair-37424022',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:50:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-xzwkg0n4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "address": "fa:16:3e:6a:13:1f", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219a0a7f-23", "ovs_interfaceid": "219a0a7f-2318-4e5c-b5da-9f9bf813174a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG os_vif [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap219a0a7f-23, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:36 user nova-compute[70659]: INFO os_vif [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:13:1f,bridge_name='br-int',has_traffic_filtering=True,id=219a0a7f-2318-4e5c-b5da-9f9bf813174a,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219a0a7f-23')
Jul 25 16:52:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Deleting instance files /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a_del
Jul 25 16:52:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Deletion of /opt/stack/data/nova/instances/9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a_del complete
Jul 25 16:52:36 user nova-compute[70659]: INFO nova.compute.manager [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Took 1.34 seconds to destroy the instance on the hypervisor.
Jul 25 16:52:36 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:52:36 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-d01393a3-b502-4da6-841f-2f777c97d909 req-84aea9b4-1575-49cd-b0f9-0b063051a32c service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d01393a3-b502-4da6-841f-2f777c97d909 req-84aea9b4-1575-49cd-b0f9-0b063051a32c service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d01393a3-b502-4da6-841f-2f777c97d909 req-84aea9b4-1575-49cd-b0f9-0b063051a32c service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d01393a3-b502-4da6-841f-2f777c97d909 req-84aea9b4-1575-49cd-b0f9-0b063051a32c service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-d01393a3-b502-4da6-841f-2f777c97d909 req-84aea9b4-1575-49cd-b0f9-0b063051a32c service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:37 user nova-compute[70659]: WARNING nova.compute.manager [req-d01393a3-b502-4da6-841f-2f777c97d909 req-84aea9b4-1575-49cd-b0f9-0b063051a32c service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:52:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-12b86ac2-e597-456e-a522-7be48faf8a2a req-23f83822-b351-4929-9215-21ae1be756ab service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-12b86ac2-e597-456e-a522-7be48faf8a2a req-23f83822-b351-4929-9215-21ae1be756ab service nova] Acquiring lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-12b86ac2-e597-456e-a522-7be48faf8a2a req-23f83822-b351-4929-9215-21ae1be756ab service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-12b86ac2-e597-456e-a522-7be48faf8a2a req-23f83822-b351-4929-9215-21ae1be756ab service nova] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-12b86ac2-e597-456e-a522-7be48faf8a2a req-23f83822-b351-4929-9215-21ae1be756ab service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] No waiting events found dispatching network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:37 user nova-compute[70659]: WARNING nova.compute.manager [req-12b86ac2-e597-456e-a522-7be48faf8a2a req-23f83822-b351-4929-9215-21ae1be756ab service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received unexpected event network-vif-plugged-219a0a7f-2318-4e5c-b5da-9f9bf813174a for instance with vm_state active and task_state deleting.
Jul 25 16:52:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "c9728d00-f454-4616-af0b-8cfd0f012cad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:38 user nova-compute[70659]: INFO nova.compute.manager [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Terminating instance
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:52:38 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Took 1.61 seconds to deallocate network for instance.
Jul 25 16:52:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 16:52:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Instance destroyed successfully.
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.objects.instance [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lazy-loading 'resources' on Instance uuid c9728d00-f454-4616-af0b-8cfd0f012cad {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1639245356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1639245356',id=4,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9W5TboWtf0hc6Hzv2eWxKxfCk+KxFbuCMcv9u2xcYbqE6AO869uvN6rqAnISctUaR6HlRbCH+L5ZFWkyQFuvY+xkmYbhIXcN3yDkQ+fFgWnpNITt3DJYkCoVIOwlofCA==',key_name='tempest-keypair-444304122',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa87ca828941408ebb81eb439ebbc79e',ramdisk_id='',reservation_id='r-wunzy08x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510925623',owner_user_name='tempest-ServerActionsV293TestJSON-510925623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad466988c34f4e06b5c631b9754db2c5',uuid=c9728d00-f454-4616-af0b-8cfd0f012cad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converting VIF {"id": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "address": "fa:16:3e:7d:69:6e", "network": {"id": "06119edd-b9dc-4455-8775-8fa408824939", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-764542634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa87ca828941408ebb81eb439ebbc79e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59982e84-3a", "ovs_interfaceid": "59982e84-3ac0-4ed7-b932-9fd142d77f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:69:6e,bridge_name='br-int',has_traffic_filtering=True,id=59982e84-3ac0-4ed7-b932-9fd142d77f8a,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59982e84-3a') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG os_vif [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:69:6e,bridge_name='br-int',has_traffic_filtering=True,id=59982e84-3ac0-4ed7-b932-9fd142d77f8a,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59982e84-3a') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59982e84-3a, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:38 user nova-compute[70659]: INFO os_vif [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:69:6e,bridge_name='br-int',has_traffic_filtering=True,id=59982e84-3ac0-4ed7-b932-9fd142d77f8a,network=Network(06119edd-b9dc-4455-8775-8fa408824939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59982e84-3a')
Jul 25 16:52:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Deleting instance files /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad_del
Jul 25 16:52:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Deletion of /opt/stack/data/nova/instances/c9728d00-f454-4616-af0b-8cfd0f012cad_del complete
Jul 25 16:52:38 user nova-compute[70659]: INFO nova.compute.manager [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Took 0.80 seconds to destroy the instance on the hypervisor.
Jul 25 16:52:38 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:52:38 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.689s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:39 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Deleted allocations for instance 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a6d9587e-3e31-4a15-82c1-7c1bbb1967b4 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.855s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:39 user nova-compute[70659]: WARNING nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Received event network-vif-deleted-219a0a7f-2318-4e5c-b5da-9f9bf813174a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:39 user nova-compute[70659]: WARNING nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received event network-vif-unplugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Acquiring lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] No waiting events found dispatching network-vif-unplugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received event network-vif-unplugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received event network-vif-plugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Acquiring lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] No waiting events found dispatching network-vif-plugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:39 user nova-compute[70659]: WARNING nova.compute.manager [req-84cf3ca4-3af2-4dfb-b678-c0f42fc152fd req-af96d877-32c4-4e5b-9c91-0eb459ccc29a service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received unexpected event network-vif-plugged-59982e84-3ac0-4ed7-b932-9fd142d77f8a for instance with vm_state active and task_state deleting.
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for c2800889-2d2e-4660-8bc9-f1f1782587d3 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303959.6339877, c2800889-2d2e-4660-8bc9-f1f1782587d3 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:39 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] VM Resumed (Lifecycle Event)
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0e7a5b8a-0155-44d7-b673-e492ea61c471 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:52:39 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303959.6385612, c2800889-2d2e-4660-8bc9-f1f1782587d3 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:39 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] VM Started (Lifecycle Event)
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:52:39 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:52:40 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Took 1.04 seconds to deallocate network for instance.
Jul 25 16:52:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:40 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:52:40 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:52:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:40 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Deleted allocations for instance c9728d00-f454-4616-af0b-8cfd0f012cad
Jul 25 16:52:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-73c20c8e-57b2-42a6-8d45-63fdb8a68ff2 tempest-ServerActionsV293TestJSON-510925623 tempest-ServerActionsV293TestJSON-510925623-project-member] Lock "c9728d00-f454-4616-af0b-8cfd0f012cad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.361s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-74a55438-c42c-4976-b7c3-455071249d81 req-7d79abd9-f8e3-49a0-9d0c-920506911613 service nova] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Received event network-vif-deleted-59982e84-3ac0-4ed7-b932-9fd142d77f8a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:45 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:52:47 user nova-compute[70659]: INFO nova.compute.claims [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Claim successful on node user
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:52:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:52:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:52:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Creating image(s)
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "/opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "/opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.154s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk 1073741824" returned: 0 in 0.053s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.154s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.policy [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e690b50640c468a8c34aa3295d451c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5fde9e2b1f445c0befe2b486a11eb9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk --force-share --output=json" returned: 0 in 0.492s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Cannot resize image /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.objects.instance [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lazy-loading 'migration_context' on Instance uuid e9edc2a1-bdba-491c-820d-7a805e268bfb {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:52:49 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:52:49 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=25.548442840576172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Ensure instance console log exists: /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 743875b3-2013-4162-9940-f1f59ca6c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e9edc2a1-bdba-491c-820d-7a805e268bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:52:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Successfully created port: 9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Successfully updated port: 9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquiring lock "refresh_cache-e9edc2a1-bdba-491c-820d-7a805e268bfb" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquired lock "refresh_cache-e9edc2a1-bdba-491c-820d-7a805e268bfb" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:52:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.compute.manager [req-4119ead9-6c9a-40e8-b681-220b491790d6 req-ef8db54f-01ff-4e19-90b8-4983dda28707 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-changed-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.compute.manager [req-4119ead9-6c9a-40e8-b681-220b491790d6 req-ef8db54f-01ff-4e19-90b8-4983dda28707 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Refreshing instance network info cache due to event network-changed-9ee6ea47-ad94-4648-a976-33679f2355e3. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4119ead9-6c9a-40e8-b681-220b491790d6 req-ef8db54f-01ff-4e19-90b8-4983dda28707 service nova] Acquiring lock "refresh_cache-e9edc2a1-bdba-491c-820d-7a805e268bfb" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.network.neutron [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.network.neutron [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Updating instance_info_cache with network_info: [{"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Releasing lock "refresh_cache-e9edc2a1-bdba-491c-820d-7a805e268bfb" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Instance network_info: |[{"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4119ead9-6c9a-40e8-b681-220b491790d6 req-ef8db54f-01ff-4e19-90b8-4983dda28707 service nova] Acquired lock "refresh_cache-e9edc2a1-bdba-491c-820d-7a805e268bfb" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.network.neutron [req-4119ead9-6c9a-40e8-b681-220b491790d6 req-ef8db54f-01ff-4e19-90b8-4983dda28707 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Refreshing network info cache for port 9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Start _get_guest_xml network_info=[{"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:52:51 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:52:51 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-82270984',display_name='tempest-VolumesNegativeTest-instance-82270984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-82270984',id=17,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5fde9e2b1f445c0befe2b486a11eb9f',ramdisk_id='',reservation_id='r-i4onutml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-121048916',owner_user_name='tempest-VolumesNegativeTest-121048916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:52:48Z,user_data=None,user_id='3e690b50640c468a8c34aa3295d451c2',uuid=e9edc2a1-bdba-491c-820d-7a805e268bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Converting VIF {"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b2:54,bridge_name='br-int',has_traffic_filtering=True,id=9ee6ea47-ad94-4648-a976-33679f2355e3,network=Network(fe011487-46ef-4541-a299-93c60d99c134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6ea47-ad') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.objects.instance [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lazy-loading 'pci_devices' on Instance uuid e9edc2a1-bdba-491c-820d-7a805e268bfb {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:52:51 user nova-compute[70659]:   <uuid>e9edc2a1-bdba-491c-820d-7a805e268bfb</uuid>
Jul 25 16:52:51 user nova-compute[70659]:   <name>instance-00000011</name>
Jul 25 16:52:51 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:52:51 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:52:51 user nova-compute[70659]:   <metadata>
Jul 25 16:52:51 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:52:51 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:52:51 user nova-compute[70659]:       <nova:name>tempest-VolumesNegativeTest-instance-82270984</nova:name>
Jul 25 16:52:51 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:52:51</nova:creationTime>
Jul 25 16:52:51 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:52:51 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:52:51 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:52:51 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:52:51 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:52:51 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:52:51 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:52:51 user nova-compute[70659]:       <nova:owner>
Jul 25 16:52:51 user nova-compute[70659]:         <nova:user uuid="3e690b50640c468a8c34aa3295d451c2">tempest-VolumesNegativeTest-121048916-project-member</nova:user>
Jul 25 16:52:51 user nova-compute[70659]:         <nova:project uuid="a5fde9e2b1f445c0befe2b486a11eb9f">tempest-VolumesNegativeTest-121048916</nova:project>
Jul 25 16:52:51 user nova-compute[70659]:       </nova:owner>
Jul 25 16:52:51 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:52:51 user nova-compute[70659]:       <nova:ports>
Jul 25 16:52:51 user nova-compute[70659]:         <nova:port uuid="9ee6ea47-ad94-4648-a976-33679f2355e3">
Jul 25 16:52:51 user nova-compute[70659]:           <nova:ip type="fixed" address="192.168.233.61" ipVersion="4"/>
Jul 25 16:52:51 user nova-compute[70659]:         </nova:port>
Jul 25 16:52:51 user nova-compute[70659]:       </nova:ports>
Jul 25 16:52:51 user nova-compute[70659]:     </nova:instance>
Jul 25 16:52:51 user nova-compute[70659]:   </metadata>
Jul 25 16:52:51 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:52:51 user nova-compute[70659]:     <system>
Jul 25 16:52:51 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:52:51 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:52:51 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:52:51 user nova-compute[70659]:       <entry name="serial">e9edc2a1-bdba-491c-820d-7a805e268bfb</entry>
Jul 25 16:52:51 user nova-compute[70659]:       <entry name="uuid">e9edc2a1-bdba-491c-820d-7a805e268bfb</entry>
Jul 25 16:52:51 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:52:51 user nova-compute[70659]:     </system>
Jul 25 16:52:51 user nova-compute[70659]:   </sysinfo>
Jul 25 16:52:51 user nova-compute[70659]:   <os>
Jul 25 16:52:51 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:52:51 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:52:51 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:52:51 user nova-compute[70659]:   </os>
Jul 25 16:52:51 user nova-compute[70659]:   <features>
Jul 25 16:52:51 user nova-compute[70659]:     <acpi/>
Jul 25 16:52:51 user nova-compute[70659]:     <apic/>
Jul 25 16:52:51 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:52:51 user nova-compute[70659]:   </features>
Jul 25 16:52:51 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:52:51 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:52:51 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:52:51 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:52:51 user nova-compute[70659]:   </clock>
Jul 25 16:52:51 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:52:51 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:52:51 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:52:51 user nova-compute[70659]:   </cpu>
Jul 25 16:52:51 user nova-compute[70659]:   <devices>
Jul 25 16:52:51 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:52:51 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:52:51 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk"/>
Jul 25 16:52:51 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:52:51 user nova-compute[70659]:     </disk>
Jul 25 16:52:51 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:52:51 user nova-compute[70659]:       <mac address="fa:16:3e:86:b2:54"/>
Jul 25 16:52:51 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:52:51 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:52:51 user nova-compute[70659]:       <target dev="tap9ee6ea47-ad"/>
Jul 25 16:52:51 user nova-compute[70659]:     </interface>
Jul 25 16:52:51 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:52:51 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/console.log" append="off"/>
Jul 25 16:52:51 user nova-compute[70659]:     </serial>
Jul 25 16:52:51 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:52:51 user nova-compute[70659]:     <video>
Jul 25 16:52:51 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:52:51 user nova-compute[70659]:     </video>
Jul 25 16:52:51 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:52:51 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:52:51 user nova-compute[70659]:     </rng>
Jul 25 16:52:51 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:52:51 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:52:51 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:52:51 user nova-compute[70659]:     </memballoon>
Jul 25 16:52:51 user nova-compute[70659]:   </devices>
Jul 25 16:52:51 user nova-compute[70659]: </domain>
Jul 25 16:52:51 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-82270984',display_name='tempest-VolumesNegativeTest-instance-82270984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-82270984',id=17,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5fde9e2b1f445c0befe2b486a11eb9f',ramdisk_id='',reservation_id='r-i4onutml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-121048916',owner_user_name='tempest-VolumesNegativeTest-121048916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:52:48Z,user_data=None,user_id='3e690b50640c468a8c34aa3295d451c2',uuid=e9edc2a1-bdba-491c-820d-7a805e268bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Converting VIF {"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b2:54,bridge_name='br-int',has_traffic_filtering=True,id=9ee6ea47-ad94-4648-a976-33679f2355e3,network=Network(fe011487-46ef-4541-a299-93c60d99c134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6ea47-ad') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG os_vif [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b2:54,bridge_name='br-int',has_traffic_filtering=True,id=9ee6ea47-ad94-4648-a976-33679f2355e3,network=Network(fe011487-46ef-4541-a299-93c60d99c134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6ea47-ad') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ee6ea47-ad, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9ee6ea47-ad, col_values=(('external_ids', {'iface-id': '9ee6ea47-ad94-4648-a976-33679f2355e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:b2:54', 'vm-uuid': 'e9edc2a1-bdba-491c-820d-7a805e268bfb'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:51 user nova-compute[70659]: INFO os_vif [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b2:54,bridge_name='br-int',has_traffic_filtering=True,id=9ee6ea47-ad94-4648-a976-33679f2355e3,network=Network(fe011487-46ef-4541-a299-93c60d99c134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6ea47-ad')
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] No VIF found with MAC fa:16:3e:86:b2:54, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303956.6599238, 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:51 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] VM Stopped (Lifecycle Event)
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fb68b9e3-c7b3-46ca-bd0e-62508838dd76 None None] [instance: 9d2f1415-9bca-43c8-9af5-1ef9cf8b3c3a] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.network.neutron [req-4119ead9-6c9a-40e8-b681-220b491790d6 req-ef8db54f-01ff-4e19-90b8-4983dda28707 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Updated VIF entry in instance network info cache for port 9ee6ea47-ad94-4648-a976-33679f2355e3. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG nova.network.neutron [req-4119ead9-6c9a-40e8-b681-220b491790d6 req-ef8db54f-01ff-4e19-90b8-4983dda28707 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Updating instance_info_cache with network_info: [{"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4119ead9-6c9a-40e8-b681-220b491790d6 req-ef8db54f-01ff-4e19-90b8-4983dda28707 service nova] Releasing lock "refresh_cache-e9edc2a1-bdba-491c-820d-7a805e268bfb" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:52:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:52 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance_info_cache with network_info: [{"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:52:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-5192b767-96f0-4789-ac74-0d6d6b5bef3e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:52:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:52:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:52:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:52:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:53 user nova-compute[70659]: DEBUG nova.compute.manager [req-9a887f4c-ea74-4970-a202-cc11469e3825 req-f1faf505-a0d3-4436-a7a1-1e654debcd08 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9a887f4c-ea74-4970-a202-cc11469e3825 req-f1faf505-a0d3-4436-a7a1-1e654debcd08 service nova] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9a887f4c-ea74-4970-a202-cc11469e3825 req-f1faf505-a0d3-4436-a7a1-1e654debcd08 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9a887f4c-ea74-4970-a202-cc11469e3825 req-f1faf505-a0d3-4436-a7a1-1e654debcd08 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:53 user nova-compute[70659]: DEBUG nova.compute.manager [req-9a887f4c-ea74-4970-a202-cc11469e3825 req-f1faf505-a0d3-4436-a7a1-1e654debcd08 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] No waiting events found dispatching network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:53 user nova-compute[70659]: WARNING nova.compute.manager [req-9a887f4c-ea74-4970-a202-cc11469e3825 req-f1faf505-a0d3-4436-a7a1-1e654debcd08 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received unexpected event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 for instance with vm_state building and task_state spawning.
Jul 25 16:52:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:53 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690303958.8379722, c9728d00-f454-4616-af0b-8cfd0f012cad => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:53 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] VM Stopped (Lifecycle Event)
Jul 25 16:52:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-acc64f01-b119-4f79-af00-522b3d66f8f9 None None] [instance: c9728d00-f454-4616-af0b-8cfd0f012cad] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303975.076912, e9edc2a1-bdba-491c-820d-7a805e268bfb => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:55 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] VM Resumed (Lifecycle Event)
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:52:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Instance spawned successfully.
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:52:55 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303975.0792837, e9edc2a1-bdba-491c-820d-7a805e268bfb => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:52:55 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] VM Started (Lifecycle Event)
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:52:55 user nova-compute[70659]: INFO nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Took 6.82 seconds to spawn the instance on the hypervisor.
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:55 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:52:55 user nova-compute[70659]: INFO nova.compute.manager [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Took 7.66 seconds to build instance.
Jul 25 16:52:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-36b1c472-1c94-483d-bce6-d9cb43c9a27d tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.804s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-e9d64f1b-250d-4de8-a05c-03cd0bc78b87 req-0fdf9728-ac3f-4fe5-b6fd-483e60331c14 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e9d64f1b-250d-4de8-a05c-03cd0bc78b87 req-0fdf9728-ac3f-4fe5-b6fd-483e60331c14 service nova] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e9d64f1b-250d-4de8-a05c-03cd0bc78b87 req-0fdf9728-ac3f-4fe5-b6fd-483e60331c14 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e9d64f1b-250d-4de8-a05c-03cd0bc78b87 req-0fdf9728-ac3f-4fe5-b6fd-483e60331c14 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-e9d64f1b-250d-4de8-a05c-03cd0bc78b87 req-0fdf9728-ac3f-4fe5-b6fd-483e60331c14 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] No waiting events found dispatching network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:52:55 user nova-compute[70659]: WARNING nova.compute.manager [req-e9d64f1b-250d-4de8-a05c-03cd0bc78b87 req-0fdf9728-ac3f-4fe5-b6fd-483e60331c14 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received unexpected event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 for instance with vm_state active and task_state None.
Jul 25 16:52:55 user nova-compute[70659]: INFO nova.compute.manager [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] instance snapshotting
Jul 25 16:52:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Beginning live snapshot process
Jul 25 16:52:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json -f qcow2 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json -f qcow2 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnkyipuw1/21939eb05dd24ee2b6dd8d8be688f9cd.delta 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnkyipuw1/21939eb05dd24ee2b6dd8d8be688f9cd.delta 1073741824" returned: 0 in 0.048s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:56 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 16:52:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "1e549abb-40d8-42d6-ae8f-508d5c13be89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:52:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:52:57 user nova-compute[70659]: INFO nova.compute.claims [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Claim successful on node user
Jul 25 16:52:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 16:52:57 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 16:52:57 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnkyipuw1/21939eb05dd24ee2b6dd8d8be688f9cd.delta /opt/stack/data/nova/instances/snapshots/tmpnkyipuw1/21939eb05dd24ee2b6dd8d8be688f9cd {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:52:57 user nova-compute[70659]: DEBUG nova.network.neutron [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:52:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:52:58 user nova-compute[70659]: DEBUG nova.policy [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c06f1babb164e4e9ae334ad5c81ab65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2a00920ce74688937a25cb3db3dd07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:52:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Creating image(s)
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "/opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "/opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnkyipuw1/21939eb05dd24ee2b6dd8d8be688f9cd.delta /opt/stack/data/nova/instances/snapshots/tmpnkyipuw1/21939eb05dd24ee2b6dd8d8be688f9cd" returned: 0 in 0.690s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Snapshot extracted, beginning image upload
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.158s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.158s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk 1073741824" returned: 0 in 0.050s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.161s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:52:58 user nova-compute[70659]: DEBUG nova.network.neutron [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Successfully created port: 1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Cannot resize image /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG nova.objects.instance [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lazy-loading 'migration_context' on Instance uuid 1e549abb-40d8-42d6-ae8f-508d5c13be89 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Ensure instance console log exists: /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG nova.network.neutron [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Successfully updated port: 1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "refresh_cache-1e549abb-40d8-42d6-ae8f-508d5c13be89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquired lock "refresh_cache-1e549abb-40d8-42d6-ae8f-508d5c13be89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG nova.network.neutron [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-ffb10722-2d61-44c7-b34a-6ce84c9c82a3 req-de0e9012-11b8-48a0-ba36-56d1c44bc3b7 service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received event network-changed-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-ffb10722-2d61-44c7-b34a-6ce84c9c82a3 req-de0e9012-11b8-48a0-ba36-56d1c44bc3b7 service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Refreshing instance network info cache due to event network-changed-1e1325bd-4f52-48a9-a4b6-613aa7c519f5. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ffb10722-2d61-44c7-b34a-6ce84c9c82a3 req-de0e9012-11b8-48a0-ba36-56d1c44bc3b7 service nova] Acquiring lock "refresh_cache-1e549abb-40d8-42d6-ae8f-508d5c13be89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:52:59 user nova-compute[70659]: DEBUG nova.network.neutron [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Updating instance_info_cache with network_info: [{"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Releasing lock "refresh_cache-1e549abb-40d8-42d6-ae8f-508d5c13be89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Instance network_info: |[{"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ffb10722-2d61-44c7-b34a-6ce84c9c82a3 req-de0e9012-11b8-48a0-ba36-56d1c44bc3b7 service nova] Acquired lock "refresh_cache-1e549abb-40d8-42d6-ae8f-508d5c13be89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-ffb10722-2d61-44c7-b34a-6ce84c9c82a3 req-de0e9012-11b8-48a0-ba36-56d1c44bc3b7 service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Refreshing network info cache for port 1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Start _get_guest_xml network_info=[{"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:53:00 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:00 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1311577862',display_name='tempest-ServersNegativeTestJSON-server-1311577862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1311577862',id=18,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a00920ce74688937a25cb3db3dd07',ramdisk_id='',reservation_id='r-f6s1wotu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1085604250',owner_user_name='tempest-ServersNegativeTestJSON-1085604250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:52:58Z,user_data=None,user_id='8c06f1babb164e4e9ae334ad5c81ab65',uuid=1e549abb-40d8-42d6-ae8f-508d5c13be89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converting VIF {"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e1325bd-4f52-48a9-a4b6-613aa7c519f5,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1325bd-4f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.objects.instance [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e549abb-40d8-42d6-ae8f-508d5c13be89 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:53:00 user nova-compute[70659]:   <uuid>1e549abb-40d8-42d6-ae8f-508d5c13be89</uuid>
Jul 25 16:53:00 user nova-compute[70659]:   <name>instance-00000012</name>
Jul 25 16:53:00 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:53:00 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:53:00 user nova-compute[70659]:   <metadata>
Jul 25 16:53:00 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:53:00 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:53:00 user nova-compute[70659]:       <nova:name>tempest-ServersNegativeTestJSON-server-1311577862</nova:name>
Jul 25 16:53:00 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:53:00</nova:creationTime>
Jul 25 16:53:00 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:53:00 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:53:00 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:53:00 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:53:00 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:53:00 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:53:00 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:53:00 user nova-compute[70659]:       <nova:owner>
Jul 25 16:53:00 user nova-compute[70659]:         <nova:user uuid="8c06f1babb164e4e9ae334ad5c81ab65">tempest-ServersNegativeTestJSON-1085604250-project-member</nova:user>
Jul 25 16:53:00 user nova-compute[70659]:         <nova:project uuid="5c2a00920ce74688937a25cb3db3dd07">tempest-ServersNegativeTestJSON-1085604250</nova:project>
Jul 25 16:53:00 user nova-compute[70659]:       </nova:owner>
Jul 25 16:53:00 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:53:00 user nova-compute[70659]:       <nova:ports>
Jul 25 16:53:00 user nova-compute[70659]:         <nova:port uuid="1e1325bd-4f52-48a9-a4b6-613aa7c519f5">
Jul 25 16:53:00 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 16:53:00 user nova-compute[70659]:         </nova:port>
Jul 25 16:53:00 user nova-compute[70659]:       </nova:ports>
Jul 25 16:53:00 user nova-compute[70659]:     </nova:instance>
Jul 25 16:53:00 user nova-compute[70659]:   </metadata>
Jul 25 16:53:00 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:53:00 user nova-compute[70659]:     <system>
Jul 25 16:53:00 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:53:00 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:53:00 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:53:00 user nova-compute[70659]:       <entry name="serial">1e549abb-40d8-42d6-ae8f-508d5c13be89</entry>
Jul 25 16:53:00 user nova-compute[70659]:       <entry name="uuid">1e549abb-40d8-42d6-ae8f-508d5c13be89</entry>
Jul 25 16:53:00 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:53:00 user nova-compute[70659]:     </system>
Jul 25 16:53:00 user nova-compute[70659]:   </sysinfo>
Jul 25 16:53:00 user nova-compute[70659]:   <os>
Jul 25 16:53:00 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:53:00 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:53:00 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:53:00 user nova-compute[70659]:   </os>
Jul 25 16:53:00 user nova-compute[70659]:   <features>
Jul 25 16:53:00 user nova-compute[70659]:     <acpi/>
Jul 25 16:53:00 user nova-compute[70659]:     <apic/>
Jul 25 16:53:00 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:53:00 user nova-compute[70659]:   </features>
Jul 25 16:53:00 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:53:00 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:53:00 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:53:00 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:53:00 user nova-compute[70659]:   </clock>
Jul 25 16:53:00 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:53:00 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:53:00 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:53:00 user nova-compute[70659]:   </cpu>
Jul 25 16:53:00 user nova-compute[70659]:   <devices>
Jul 25 16:53:00 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:53:00 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:53:00 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk"/>
Jul 25 16:53:00 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:53:00 user nova-compute[70659]:     </disk>
Jul 25 16:53:00 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:53:00 user nova-compute[70659]:       <mac address="fa:16:3e:e1:9e:fa"/>
Jul 25 16:53:00 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:53:00 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:53:00 user nova-compute[70659]:       <target dev="tap1e1325bd-4f"/>
Jul 25 16:53:00 user nova-compute[70659]:     </interface>
Jul 25 16:53:00 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:53:00 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/console.log" append="off"/>
Jul 25 16:53:00 user nova-compute[70659]:     </serial>
Jul 25 16:53:00 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:53:00 user nova-compute[70659]:     <video>
Jul 25 16:53:00 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:53:00 user nova-compute[70659]:     </video>
Jul 25 16:53:00 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:53:00 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:53:00 user nova-compute[70659]:     </rng>
Jul 25 16:53:00 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:53:00 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:53:00 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:53:00 user nova-compute[70659]:     </memballoon>
Jul 25 16:53:00 user nova-compute[70659]:   </devices>
Jul 25 16:53:00 user nova-compute[70659]: </domain>
Jul 25 16:53:00 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1311577862',display_name='tempest-ServersNegativeTestJSON-server-1311577862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1311577862',id=18,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2a00920ce74688937a25cb3db3dd07',ramdisk_id='',reservation_id='r-f6s1wotu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1085604250',owner_user_name='tempest-ServersNegativeTestJSON-1085604250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:52:58Z,user_data=None,user_id='8c06f1babb164e4e9ae334ad5c81ab65',uuid=1e549abb-40d8-42d6-ae8f-508d5c13be89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converting VIF {"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e1325bd-4f52-48a9-a4b6-613aa7c519f5,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1325bd-4f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG os_vif [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e1325bd-4f52-48a9-a4b6-613aa7c519f5,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1325bd-4f') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e1325bd-4f, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e1325bd-4f, col_values=(('external_ids', {'iface-id': '1e1325bd-4f52-48a9-a4b6-613aa7c519f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:9e:fa', 'vm-uuid': '1e549abb-40d8-42d6-ae8f-508d5c13be89'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:00 user nova-compute[70659]: INFO os_vif [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e1325bd-4f52-48a9-a4b6-613aa7c519f5,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1325bd-4f')
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] No VIF found with MAC fa:16:3e:e1:9e:fa, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-ffb10722-2d61-44c7-b34a-6ce84c9c82a3 req-de0e9012-11b8-48a0-ba36-56d1c44bc3b7 service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Updated VIF entry in instance network info cache for port 1e1325bd-4f52-48a9-a4b6-613aa7c519f5. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-ffb10722-2d61-44c7-b34a-6ce84c9c82a3 req-de0e9012-11b8-48a0-ba36-56d1c44bc3b7 service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Updating instance_info_cache with network_info: [{"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:53:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ffb10722-2d61-44c7-b34a-6ce84c9c82a3 req-de0e9012-11b8-48a0-ba36-56d1c44bc3b7 service nova] Releasing lock "refresh_cache-1e549abb-40d8-42d6-ae8f-508d5c13be89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:53:01 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Snapshot image upload complete
Jul 25 16:53:01 user nova-compute[70659]: INFO nova.compute.manager [None req-f9594521-f2a7-4cff-a7de-9cb1714cae8e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Took 5.58 seconds to snapshot the instance on the hypervisor.
Jul 25 16:53:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-bec1f945-0b16-4137-864c-1488a1f95fcc req-267a9cd9-47f5-4530-9c3f-897d323ec42f service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received event network-vif-plugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bec1f945-0b16-4137-864c-1488a1f95fcc req-267a9cd9-47f5-4530-9c3f-897d323ec42f service nova] Acquiring lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bec1f945-0b16-4137-864c-1488a1f95fcc req-267a9cd9-47f5-4530-9c3f-897d323ec42f service nova] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bec1f945-0b16-4137-864c-1488a1f95fcc req-267a9cd9-47f5-4530-9c3f-897d323ec42f service nova] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-bec1f945-0b16-4137-864c-1488a1f95fcc req-267a9cd9-47f5-4530-9c3f-897d323ec42f service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] No waiting events found dispatching network-vif-plugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:53:02 user nova-compute[70659]: WARNING nova.compute.manager [req-bec1f945-0b16-4137-864c-1488a1f95fcc req-267a9cd9-47f5-4530-9c3f-897d323ec42f service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received unexpected event network-vif-plugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 for instance with vm_state building and task_state spawning.
Jul 25 16:53:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303984.0154493, 1e549abb-40d8-42d6-ae8f-508d5c13be89 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:53:04 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] VM Resumed (Lifecycle Event)
Jul 25 16:53:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Instance spawned successfully.
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:04 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303984.015609, 1e549abb-40d8-42d6-ae8f-508d5c13be89 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:53:04 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] VM Started (Lifecycle Event)
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:53:04 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:53:04 user nova-compute[70659]: INFO nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Took 5.85 seconds to spawn the instance on the hypervisor.
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc753c89-997e-4f47-a822-0e7c560780b3 req-5718258d-ce42-4cbd-b821-fe9bd839c959 service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received event network-vif-plugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc753c89-997e-4f47-a822-0e7c560780b3 req-5718258d-ce42-4cbd-b821-fe9bd839c959 service nova] Acquiring lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc753c89-997e-4f47-a822-0e7c560780b3 req-5718258d-ce42-4cbd-b821-fe9bd839c959 service nova] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc753c89-997e-4f47-a822-0e7c560780b3 req-5718258d-ce42-4cbd-b821-fe9bd839c959 service nova] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc753c89-997e-4f47-a822-0e7c560780b3 req-5718258d-ce42-4cbd-b821-fe9bd839c959 service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] No waiting events found dispatching network-vif-plugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:53:04 user nova-compute[70659]: WARNING nova.compute.manager [req-dc753c89-997e-4f47-a822-0e7c560780b3 req-5718258d-ce42-4cbd-b821-fe9bd839c959 service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received unexpected event network-vif-plugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 for instance with vm_state building and task_state spawning.
Jul 25 16:53:04 user nova-compute[70659]: INFO nova.compute.manager [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Took 7.13 seconds to build instance.
Jul 25 16:53:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51442527-3bd3-4ba5-93f4-bd4722263c9e tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.301s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:53:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:06 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:53:06 user nova-compute[70659]: INFO nova.compute.claims [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Claim successful on node user
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:53:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.policy [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f464245ee7be409e8dee782665392b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725c777c803f4e88ba9ab61087cdd31e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:53:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Creating image(s)
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "/opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "/opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk 1073741824" returned: 0 in 0.049s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:53:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Cannot resize image /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'migration_context' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Ensure instance console log exists: /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Successfully created port: 7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Successfully updated port: 7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquired lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:53:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-d322768a-6346-4094-b9c5-dd67981a6a8d req-fb432dea-d70b-4ecd-bb08-31d8849d87a4 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received event network-changed-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-d322768a-6346-4094-b9c5-dd67981a6a8d req-fb432dea-d70b-4ecd-bb08-31d8849d87a4 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Refreshing instance network info cache due to event network-changed-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d322768a-6346-4094-b9c5-dd67981a6a8d req-fb432dea-d70b-4ecd-bb08-31d8849d87a4 service nova] Acquiring lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updating instance_info_cache with network_info: [{"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Releasing lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Instance network_info: |[{"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d322768a-6346-4094-b9c5-dd67981a6a8d req-fb432dea-d70b-4ecd-bb08-31d8849d87a4 service nova] Acquired lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.network.neutron [req-d322768a-6346-4094-b9c5-dd67981a6a8d req-fb432dea-d70b-4ecd-bb08-31d8849d87a4 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Refreshing network info cache for port 7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Start _get_guest_xml network_info=[{"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:53:09 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:09 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1536461684',display_name='tempest-SnapshotDataIntegrityTests-server-1536461684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1536461684',id=19,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuVkZmNvixwDG6NLlmdU3M0sUwLZdteWs6RCK5Fxf5ZwQEXNlfutETo+f87tj3kW8XrpO4gZyzJenjbmp4H8eC3cYEVyul/uRuldYiM5e2VGRC729j4CoDBBUaQFgltvg==',key_name='tempest-keypair-1247728674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='725c777c803f4e88ba9ab61087cdd31e',ramdisk_id='',reservation_id='r-mz0jj0ue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-388486524',owner_user_name='tempest-SnapshotDataIntegrityTests-388486524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:53:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f464245ee7be409e8dee782665392b6c',uuid=f6fba6f6-ff72-43c2-b824-f262bf430eac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Converting VIF {"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:c8,bridge_name='br-int',has_traffic_filtering=True,id=7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c,network=Network(502ae5ae-02dd-4f97-8c49-0de37e938a26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7350aa2e-c1') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'pci_devices' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:53:09 user nova-compute[70659]:   <uuid>f6fba6f6-ff72-43c2-b824-f262bf430eac</uuid>
Jul 25 16:53:09 user nova-compute[70659]:   <name>instance-00000013</name>
Jul 25 16:53:09 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:53:09 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:53:09 user nova-compute[70659]:   <metadata>
Jul 25 16:53:09 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:53:09 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:53:09 user nova-compute[70659]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1536461684</nova:name>
Jul 25 16:53:09 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:53:09</nova:creationTime>
Jul 25 16:53:09 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:53:09 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:53:09 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:53:09 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:53:09 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:53:09 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:53:09 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:53:09 user nova-compute[70659]:       <nova:owner>
Jul 25 16:53:09 user nova-compute[70659]:         <nova:user uuid="f464245ee7be409e8dee782665392b6c">tempest-SnapshotDataIntegrityTests-388486524-project-member</nova:user>
Jul 25 16:53:09 user nova-compute[70659]:         <nova:project uuid="725c777c803f4e88ba9ab61087cdd31e">tempest-SnapshotDataIntegrityTests-388486524</nova:project>
Jul 25 16:53:09 user nova-compute[70659]:       </nova:owner>
Jul 25 16:53:09 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:53:09 user nova-compute[70659]:       <nova:ports>
Jul 25 16:53:09 user nova-compute[70659]:         <nova:port uuid="7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c">
Jul 25 16:53:09 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 16:53:09 user nova-compute[70659]:         </nova:port>
Jul 25 16:53:09 user nova-compute[70659]:       </nova:ports>
Jul 25 16:53:09 user nova-compute[70659]:     </nova:instance>
Jul 25 16:53:09 user nova-compute[70659]:   </metadata>
Jul 25 16:53:09 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:53:09 user nova-compute[70659]:     <system>
Jul 25 16:53:09 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:53:09 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:53:09 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:53:09 user nova-compute[70659]:       <entry name="serial">f6fba6f6-ff72-43c2-b824-f262bf430eac</entry>
Jul 25 16:53:09 user nova-compute[70659]:       <entry name="uuid">f6fba6f6-ff72-43c2-b824-f262bf430eac</entry>
Jul 25 16:53:09 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:53:09 user nova-compute[70659]:     </system>
Jul 25 16:53:09 user nova-compute[70659]:   </sysinfo>
Jul 25 16:53:09 user nova-compute[70659]:   <os>
Jul 25 16:53:09 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:53:09 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:53:09 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:53:09 user nova-compute[70659]:   </os>
Jul 25 16:53:09 user nova-compute[70659]:   <features>
Jul 25 16:53:09 user nova-compute[70659]:     <acpi/>
Jul 25 16:53:09 user nova-compute[70659]:     <apic/>
Jul 25 16:53:09 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:53:09 user nova-compute[70659]:   </features>
Jul 25 16:53:09 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:53:09 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:53:09 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:53:09 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:53:09 user nova-compute[70659]:   </clock>
Jul 25 16:53:09 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:53:09 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:53:09 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:53:09 user nova-compute[70659]:   </cpu>
Jul 25 16:53:09 user nova-compute[70659]:   <devices>
Jul 25 16:53:09 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:53:09 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:53:09 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk"/>
Jul 25 16:53:09 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:53:09 user nova-compute[70659]:     </disk>
Jul 25 16:53:09 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:53:09 user nova-compute[70659]:       <mac address="fa:16:3e:56:91:c8"/>
Jul 25 16:53:09 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:53:09 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:53:09 user nova-compute[70659]:       <target dev="tap7350aa2e-c1"/>
Jul 25 16:53:09 user nova-compute[70659]:     </interface>
Jul 25 16:53:09 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:53:09 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/console.log" append="off"/>
Jul 25 16:53:09 user nova-compute[70659]:     </serial>
Jul 25 16:53:09 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:53:09 user nova-compute[70659]:     <video>
Jul 25 16:53:09 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:53:09 user nova-compute[70659]:     </video>
Jul 25 16:53:09 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:53:09 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:53:09 user nova-compute[70659]:     </rng>
Jul 25 16:53:09 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:53:09 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:53:09 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:53:09 user nova-compute[70659]:     </memballoon>
Jul 25 16:53:09 user nova-compute[70659]:   </devices>
Jul 25 16:53:09 user nova-compute[70659]: </domain>
Jul 25 16:53:09 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1536461684',display_name='tempest-SnapshotDataIntegrityTests-server-1536461684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1536461684',id=19,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuVkZmNvixwDG6NLlmdU3M0sUwLZdteWs6RCK5Fxf5ZwQEXNlfutETo+f87tj3kW8XrpO4gZyzJenjbmp4H8eC3cYEVyul/uRuldYiM5e2VGRC729j4CoDBBUaQFgltvg==',key_name='tempest-keypair-1247728674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='725c777c803f4e88ba9ab61087cdd31e',ramdisk_id='',reservation_id='r-mz0jj0ue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-388486524',owner_user_name='tempest-SnapshotDataIntegrityTests-388486524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:53:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f464245ee7be409e8dee782665392b6c',uuid=f6fba6f6-ff72-43c2-b824-f262bf430eac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Converting VIF {"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:c8,bridge_name='br-int',has_traffic_filtering=True,id=7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c,network=Network(502ae5ae-02dd-4f97-8c49-0de37e938a26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7350aa2e-c1') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG os_vif [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:c8,bridge_name='br-int',has_traffic_filtering=True,id=7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c,network=Network(502ae5ae-02dd-4f97-8c49-0de37e938a26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7350aa2e-c1') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7350aa2e-c1, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7350aa2e-c1, col_values=(('external_ids', {'iface-id': '7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:91:c8', 'vm-uuid': 'f6fba6f6-ff72-43c2-b824-f262bf430eac'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:09 user nova-compute[70659]: INFO os_vif [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:c8,bridge_name='br-int',has_traffic_filtering=True,id=7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c,network=Network(502ae5ae-02dd-4f97-8c49-0de37e938a26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7350aa2e-c1')
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:53:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No VIF found with MAC fa:16:3e:56:91:c8, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:53:10 user nova-compute[70659]: DEBUG nova.network.neutron [req-d322768a-6346-4094-b9c5-dd67981a6a8d req-fb432dea-d70b-4ecd-bb08-31d8849d87a4 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updated VIF entry in instance network info cache for port 7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:53:10 user nova-compute[70659]: DEBUG nova.network.neutron [req-d322768a-6346-4094-b9c5-dd67981a6a8d req-fb432dea-d70b-4ecd-bb08-31d8849d87a4 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updating instance_info_cache with network_info: [{"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:53:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d322768a-6346-4094-b9c5-dd67981a6a8d req-fb432dea-d70b-4ecd-bb08-31d8849d87a4 service nova] Releasing lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:53:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-1b6d876f-d57b-4b9f-a558-d24aefe31a7d req-bfbaf630-0df9-41af-bac1-e2286f2ffdec service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received event network-vif-plugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1b6d876f-d57b-4b9f-a558-d24aefe31a7d req-bfbaf630-0df9-41af-bac1-e2286f2ffdec service nova] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1b6d876f-d57b-4b9f-a558-d24aefe31a7d req-bfbaf630-0df9-41af-bac1-e2286f2ffdec service nova] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1b6d876f-d57b-4b9f-a558-d24aefe31a7d req-bfbaf630-0df9-41af-bac1-e2286f2ffdec service nova] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-1b6d876f-d57b-4b9f-a558-d24aefe31a7d req-bfbaf630-0df9-41af-bac1-e2286f2ffdec service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] No waiting events found dispatching network-vif-plugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:53:11 user nova-compute[70659]: WARNING nova.compute.manager [req-1b6d876f-d57b-4b9f-a558-d24aefe31a7d req-bfbaf630-0df9-41af-bac1-e2286f2ffdec service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received unexpected event network-vif-plugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c for instance with vm_state building and task_state spawning.
Jul 25 16:53:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303992.8595147, f6fba6f6-ff72-43c2-b824-f262bf430eac => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:53:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] VM Resumed (Lifecycle Event)
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:53:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Instance spawned successfully.
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:53:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690303992.860563, f6fba6f6-ff72-43c2-b824-f262bf430eac => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:53:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] VM Started (Lifecycle Event)
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:53:12 user nova-compute[70659]: INFO nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Took 5.55 seconds to spawn the instance on the hypervisor.
Jul 25 16:53:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:53:13 user nova-compute[70659]: INFO nova.compute.manager [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Took 6.32 seconds to build instance.
Jul 25 16:53:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2867dbac-7ba1-4941-9fc4-b24ec17e2fbd tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-e94d7aca-5874-4f39-9bca-60a62fa695fe req-7e175d1c-701c-4408-8c74-82a910a270cb service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received event network-vif-plugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e94d7aca-5874-4f39-9bca-60a62fa695fe req-7e175d1c-701c-4408-8c74-82a910a270cb service nova] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e94d7aca-5874-4f39-9bca-60a62fa695fe req-7e175d1c-701c-4408-8c74-82a910a270cb service nova] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e94d7aca-5874-4f39-9bca-60a62fa695fe req-7e175d1c-701c-4408-8c74-82a910a270cb service nova] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-e94d7aca-5874-4f39-9bca-60a62fa695fe req-7e175d1c-701c-4408-8c74-82a910a270cb service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] No waiting events found dispatching network-vif-plugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:53:13 user nova-compute[70659]: WARNING nova.compute.manager [req-e94d7aca-5874-4f39-9bca-60a62fa695fe req-7e175d1c-701c-4408-8c74-82a910a270cb service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received unexpected event network-vif-plugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c for instance with vm_state active and task_state None.
Jul 25 16:53:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:53:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:29 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:53:29 user nova-compute[70659]: INFO nova.compute.claims [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Claim successful on node user
Jul 25 16:53:30 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:53:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:53:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:53:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Creating image(s)
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG nova.policy [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd26fb262d7b47638bb0a0df0ea10c24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ac672b01748d191239756a58474c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk 1073741824" returned: 0 in 0.048s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Cannot resize image /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'migration_context' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Ensure instance console log exists: /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:31 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Successfully created port: f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Successfully updated port: f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquired lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-0d949495-3da3-426d-878b-f37afb1b5c76 req-a4d046af-55c4-4203-85ba-ba6fd906bd12 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-changed-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-0d949495-3da3-426d-878b-f37afb1b5c76 req-a4d046af-55c4-4203-85ba-ba6fd906bd12 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Refreshing instance network info cache due to event network-changed-f4400904-3e5b-4610-af28-f24e8fa7cf20. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0d949495-3da3-426d-878b-f37afb1b5c76 req-a4d046af-55c4-4203-85ba-ba6fd906bd12 service nova] Acquiring lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updating instance_info_cache with network_info: [{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Releasing lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance network_info: |[{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0d949495-3da3-426d-878b-f37afb1b5c76 req-a4d046af-55c4-4203-85ba-ba6fd906bd12 service nova] Acquired lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.network.neutron [req-0d949495-3da3-426d-878b-f37afb1b5c76 req-a4d046af-55c4-4203-85ba-ba6fd906bd12 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Refreshing network info cache for port f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Start _get_guest_xml network_info=[{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:53:32 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:32 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-815855632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-815855632',id=20,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEhfa9iHsO529jZd+ffyn0xgIeD3MkiLeQj4DSuZj0p+9yqHe4kmVenPeuEhWGcZMGBx9M4O28CgevctYuBC1FmZHBEY+z6gI3w9uclc7fmYcY3N0HsTx8SOr76rKzjsA==',key_name='tempest-keypair-584068859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-3bjpe9kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=f201428e-c462-4cf2-881c-6712801f2e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:53:32 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'pci_devices' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:53:33 user nova-compute[70659]:   <uuid>f201428e-c462-4cf2-881c-6712801f2e02</uuid>
Jul 25 16:53:33 user nova-compute[70659]:   <name>instance-00000014</name>
Jul 25 16:53:33 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:53:33 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:53:33 user nova-compute[70659]:   <metadata>
Jul 25 16:53:33 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:53:33 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:53:33 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-815855632</nova:name>
Jul 25 16:53:33 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:53:32</nova:creationTime>
Jul 25 16:53:33 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:53:33 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:53:33 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:53:33 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:53:33 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:53:33 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:53:33 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:53:33 user nova-compute[70659]:       <nova:owner>
Jul 25 16:53:33 user nova-compute[70659]:         <nova:user uuid="bd26fb262d7b47638bb0a0df0ea10c24">tempest-AttachVolumeShelveTestJSON-569325814-project-member</nova:user>
Jul 25 16:53:33 user nova-compute[70659]:         <nova:project uuid="6b9ac672b01748d191239756a58474c3">tempest-AttachVolumeShelveTestJSON-569325814</nova:project>
Jul 25 16:53:33 user nova-compute[70659]:       </nova:owner>
Jul 25 16:53:33 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:53:33 user nova-compute[70659]:       <nova:ports>
Jul 25 16:53:33 user nova-compute[70659]:         <nova:port uuid="f4400904-3e5b-4610-af28-f24e8fa7cf20">
Jul 25 16:53:33 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 16:53:33 user nova-compute[70659]:         </nova:port>
Jul 25 16:53:33 user nova-compute[70659]:       </nova:ports>
Jul 25 16:53:33 user nova-compute[70659]:     </nova:instance>
Jul 25 16:53:33 user nova-compute[70659]:   </metadata>
Jul 25 16:53:33 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:53:33 user nova-compute[70659]:     <system>
Jul 25 16:53:33 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:53:33 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:53:33 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:53:33 user nova-compute[70659]:       <entry name="serial">f201428e-c462-4cf2-881c-6712801f2e02</entry>
Jul 25 16:53:33 user nova-compute[70659]:       <entry name="uuid">f201428e-c462-4cf2-881c-6712801f2e02</entry>
Jul 25 16:53:33 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:53:33 user nova-compute[70659]:     </system>
Jul 25 16:53:33 user nova-compute[70659]:   </sysinfo>
Jul 25 16:53:33 user nova-compute[70659]:   <os>
Jul 25 16:53:33 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:53:33 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:53:33 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:53:33 user nova-compute[70659]:   </os>
Jul 25 16:53:33 user nova-compute[70659]:   <features>
Jul 25 16:53:33 user nova-compute[70659]:     <acpi/>
Jul 25 16:53:33 user nova-compute[70659]:     <apic/>
Jul 25 16:53:33 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:53:33 user nova-compute[70659]:   </features>
Jul 25 16:53:33 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:53:33 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:53:33 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:53:33 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:53:33 user nova-compute[70659]:   </clock>
Jul 25 16:53:33 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:53:33 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:53:33 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:53:33 user nova-compute[70659]:   </cpu>
Jul 25 16:53:33 user nova-compute[70659]:   <devices>
Jul 25 16:53:33 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:53:33 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:53:33 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk"/>
Jul 25 16:53:33 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:53:33 user nova-compute[70659]:     </disk>
Jul 25 16:53:33 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:53:33 user nova-compute[70659]:       <mac address="fa:16:3e:08:86:68"/>
Jul 25 16:53:33 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:53:33 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:53:33 user nova-compute[70659]:       <target dev="tapf4400904-3e"/>
Jul 25 16:53:33 user nova-compute[70659]:     </interface>
Jul 25 16:53:33 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:53:33 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/console.log" append="off"/>
Jul 25 16:53:33 user nova-compute[70659]:     </serial>
Jul 25 16:53:33 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:53:33 user nova-compute[70659]:     <video>
Jul 25 16:53:33 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:53:33 user nova-compute[70659]:     </video>
Jul 25 16:53:33 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:53:33 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:53:33 user nova-compute[70659]:     </rng>
Jul 25 16:53:33 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:53:33 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:53:33 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:53:33 user nova-compute[70659]:     </memballoon>
Jul 25 16:53:33 user nova-compute[70659]:   </devices>
Jul 25 16:53:33 user nova-compute[70659]: </domain>
Jul 25 16:53:33 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-815855632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-815855632',id=20,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEhfa9iHsO529jZd+ffyn0xgIeD3MkiLeQj4DSuZj0p+9yqHe4kmVenPeuEhWGcZMGBx9M4O28CgevctYuBC1FmZHBEY+z6gI3w9uclc7fmYcY3N0HsTx8SOr76rKzjsA==',key_name='tempest-keypair-584068859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-3bjpe9kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=f201428e-c462-4cf2-881c-6712801f2e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG os_vif [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4400904-3e, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4400904-3e, col_values=(('external_ids', {'iface-id': 'f4400904-3e5b-4610-af28-f24e8fa7cf20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:86:68', 'vm-uuid': 'f201428e-c462-4cf2-881c-6712801f2e02'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:33 user nova-compute[70659]: INFO os_vif [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e')
Jul 25 16:53:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] No VIF found with MAC fa:16:3e:08:86:68, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-0d949495-3da3-426d-878b-f37afb1b5c76 req-a4d046af-55c4-4203-85ba-ba6fd906bd12 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updated VIF entry in instance network info cache for port f4400904-3e5b-4610-af28-f24e8fa7cf20. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-0d949495-3da3-426d-878b-f37afb1b5c76 req-a4d046af-55c4-4203-85ba-ba6fd906bd12 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updating instance_info_cache with network_info: [{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:53:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0d949495-3da3-426d-878b-f37afb1b5c76 req-a4d046af-55c4-4203-85ba-ba6fd906bd12 service nova] Releasing lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:53:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-19f2ed7d-189f-492a-83ca-efef05196325 req-f010d7f3-4ef1-481e-b458-6f818f9bf9e0 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-19f2ed7d-189f-492a-83ca-efef05196325 req-f010d7f3-4ef1-481e-b458-6f818f9bf9e0 service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-19f2ed7d-189f-492a-83ca-efef05196325 req-f010d7f3-4ef1-481e-b458-6f818f9bf9e0 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-19f2ed7d-189f-492a-83ca-efef05196325 req-f010d7f3-4ef1-481e-b458-6f818f9bf9e0 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-19f2ed7d-189f-492a-83ca-efef05196325 req-f010d7f3-4ef1-481e-b458-6f818f9bf9e0 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:53:34 user nova-compute[70659]: WARNING nova.compute.manager [req-19f2ed7d-189f-492a-83ca-efef05196325 req-f010d7f3-4ef1-481e-b458-6f818f9bf9e0 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state building and task_state spawning.
Jul 25 16:53:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-844e5f42-6582-4f81-a47c-01986cabbdbf req-a61c0d0d-3d33-427a-835a-22f94b2234b8 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received event network-changed-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-844e5f42-6582-4f81-a47c-01986cabbdbf req-a61c0d0d-3d33-427a-835a-22f94b2234b8 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Refreshing instance network info cache due to event network-changed-02a3b00a-b9f6-4472-9186-c7db2e916cb9. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-844e5f42-6582-4f81-a47c-01986cabbdbf req-a61c0d0d-3d33-427a-835a-22f94b2234b8 service nova] Acquiring lock "refresh_cache-743875b3-2013-4162-9940-f1f59ca6c7f6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-844e5f42-6582-4f81-a47c-01986cabbdbf req-a61c0d0d-3d33-427a-835a-22f94b2234b8 service nova] Acquired lock "refresh_cache-743875b3-2013-4162-9940-f1f59ca6c7f6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG nova.network.neutron [req-844e5f42-6582-4f81-a47c-01986cabbdbf req-a61c0d0d-3d33-427a-835a-22f94b2234b8 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Refreshing network info cache for port 02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-8bbe3185-bba2-43a5-b06e-9d0215dc9a48 req-26ab523e-38e3-47ec-a7c4-2520bb9502a4 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8bbe3185-bba2-43a5-b06e-9d0215dc9a48 req-26ab523e-38e3-47ec-a7c4-2520bb9502a4 service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8bbe3185-bba2-43a5-b06e-9d0215dc9a48 req-26ab523e-38e3-47ec-a7c4-2520bb9502a4 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8bbe3185-bba2-43a5-b06e-9d0215dc9a48 req-26ab523e-38e3-47ec-a7c4-2520bb9502a4 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-8bbe3185-bba2-43a5-b06e-9d0215dc9a48 req-26ab523e-38e3-47ec-a7c4-2520bb9502a4 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:53:36 user nova-compute[70659]: WARNING nova.compute.manager [req-8bbe3185-bba2-43a5-b06e-9d0215dc9a48 req-26ab523e-38e3-47ec-a7c4-2520bb9502a4 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state building and task_state spawning.
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304017.0402257, f201428e-c462-4cf2-881c-6712801f2e02 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:53:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] VM Resumed (Lifecycle Event)
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:53:37 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance spawned successfully.
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-844e5f42-6582-4f81-a47c-01986cabbdbf req-a61c0d0d-3d33-427a-835a-22f94b2234b8 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Updated VIF entry in instance network info cache for port 02a3b00a-b9f6-4472-9186-c7db2e916cb9. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-844e5f42-6582-4f81-a47c-01986cabbdbf req-a61c0d0d-3d33-427a-835a-22f94b2234b8 service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Updating instance_info_cache with network_info: [{"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:53:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304017.0432763, f201428e-c462-4cf2-881c-6712801f2e02 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:53:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] VM Started (Lifecycle Event)
Jul 25 16:53:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-844e5f42-6582-4f81-a47c-01986cabbdbf req-a61c0d0d-3d33-427a-835a-22f94b2234b8 service nova] Releasing lock "refresh_cache-743875b3-2013-4162-9940-f1f59ca6c7f6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:53:37 user nova-compute[70659]: INFO nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Took 6.46 seconds to spawn the instance on the hypervisor.
Jul 25 16:53:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:53:37 user nova-compute[70659]: INFO nova.compute.manager [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Took 7.34 seconds to build instance.
Jul 25 16:53:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2e1e127e-6d82-43df-af87-9be4fa575835 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.438s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG nova.objects.instance [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lazy-loading 'flavor' on Instance uuid 743875b3-2013-4162-9940-f1f59ca6c7f6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:40 user nova-compute[70659]: INFO nova.compute.manager [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Attaching volume a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 to /dev/vdb
Jul 25 16:53:40 user nova-compute[70659]: DEBUG os_brick.utils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb1353f-f464-478c-832b-1ef5739e560d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f70233-f25c-4635-9f75-957554c144a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9b0ca5-6370-4706-a2d3-8d7b41d79e52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[960ae4e2-c5bf-42d9-9ed6-f9076b39371e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:53:40 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:53:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[374ca94c-efc7-46b0-958f-c53561118053]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG os_brick.utils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:53:40 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Updating existing volume attachment record: 02d789dd-d5b9-46a6-9acf-132d2422101f {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:53:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHQYayuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:53:47 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:53:47 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:53:47 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bd7b32-04c8-4b6d-8a01-725d5add1dc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:53:47 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d055485-4d79-4059-8dd3-fc40a623a045]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470] added
Jul 25 16:53:47 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef7e252-791d-4ef8-b927-063d7bedc81a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8615fa3-fc65-4f54-9795-f8f01e69f8c7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fHQYayuq {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fHQYayuq" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[965aac0a-9701-4c56-8531-8390935beca6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:47 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fHQYayuq'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[358aefbc-a12d-4686-b06f-0ab2daa01369]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d858d1c-47dc-418e-aba3-72f76f59e9e5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:53:48 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:53:48 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63fc01c-3007-49ba-a7d4-4335d6552d29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470, portal: 172.16.0.220,3260]
Jul 25 16:53:48 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470, portal: 172.16.0.220,3260] successful.
Jul 25 16:53:48 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[27471ea3-bdd0-406b-9d59-0e0744403813]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc79b2f-99c6-4302-a435-413a137c0443]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:53:48 user nova-compute[70659]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 (non-flash)
Jul 25 16:53:48 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:53:48 user nova-compute[70659]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 (non-flash)
Jul 25 16:53:48 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e3e7df-4412-4f91-91b8-5e000a15a39c]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHQYayuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26334653839653266', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334653839653266', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.objects.instance [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lazy-loading 'flavor' on Instance uuid 743875b3-2013-4162-9940-f1f59ca6c7f6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:53:49 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:53:49 user nova-compute[70659]:   <source dev="/dev/sdc"/>
Jul 25 16:53:49 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:53:49 user nova-compute[70659]:   <serial>a91b2e0d-cb1b-4adf-9496-8bfcff4e4470</serial>
Jul 25 16:53:49 user nova-compute[70659]: </disk>
Jul 25 16:53:49 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquired lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'info_cache' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] No VIF found with MAC fa:16:3e:4e:25:b1, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44984a68-feff-48c5-ab90-b83e694c661a tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.254s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updating instance_info_cache with network_info: [{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Releasing lock "refresh_cache-9df22b5f-c0e3-4eb5-9054-c593d0660ee5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:53:50 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance destroyed successfully.
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'resources' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252348890',display_name='tempest-AttachVolumeTestJSON-server-1252348890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252348890',id=5,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl7hEIoOzploaaVJzvHH8s9XWd3DqHJQDS4RGFYYAnouMce0kg5Qq6bJLKJ1xPuEcKILYqVCIIw7SRQhcjnOOD1emebVM/xSSTVD/YqNbIqjFDTdfW8AR1dAleT+Ed0Qw==',key_name='tempest-keypair-1208202396',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-dwrzw3y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:51:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=9df22b5f-c0e3-4eb5-9054-c593d0660ee5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG os_vif [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c7f2734-73, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:53:50 user nova-compute[70659]: INFO os_vif [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73')
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Start _get_guest_xml network_info=[{"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'numa_topology' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:50 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:50 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252348890',display_name='tempest-AttachVolumeTestJSON-server-1252348890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252348890',id=5,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl7hEIoOzploaaVJzvHH8s9XWd3DqHJQDS4RGFYYAnouMce0kg5Qq6bJLKJ1xPuEcKILYqVCIIw7SRQhcjnOOD1emebVM/xSSTVD/YqNbIqjFDTdfW8AR1dAleT+Ed0Qw==',key_name='tempest-keypair-1208202396',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-dwrzw3y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:51:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=9df22b5f-c0e3-4eb5-9054-c593d0660ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'pci_devices' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:53:50 user nova-compute[70659]:   <uuid>9df22b5f-c0e3-4eb5-9054-c593d0660ee5</uuid>
Jul 25 16:53:50 user nova-compute[70659]:   <name>instance-00000005</name>
Jul 25 16:53:50 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:53:50 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:53:50 user nova-compute[70659]:   <metadata>
Jul 25 16:53:50 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:53:50 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:53:50 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeTestJSON-server-1252348890</nova:name>
Jul 25 16:53:50 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:53:50</nova:creationTime>
Jul 25 16:53:50 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:53:50 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:53:50 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:53:50 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:53:50 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:53:50 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:53:50 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:53:50 user nova-compute[70659]:       <nova:owner>
Jul 25 16:53:50 user nova-compute[70659]:         <nova:user uuid="a77a77d2b1954c10ace66ba38fd9ff6c">tempest-AttachVolumeTestJSON-212658614-project-member</nova:user>
Jul 25 16:53:50 user nova-compute[70659]:         <nova:project uuid="07de6ba95db444b5b10d51ef16525948">tempest-AttachVolumeTestJSON-212658614</nova:project>
Jul 25 16:53:50 user nova-compute[70659]:       </nova:owner>
Jul 25 16:53:50 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:53:50 user nova-compute[70659]:       <nova:ports>
Jul 25 16:53:50 user nova-compute[70659]:         <nova:port uuid="3c7f2734-73c4-4648-a080-0ea25238dad8">
Jul 25 16:53:50 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 16:53:50 user nova-compute[70659]:         </nova:port>
Jul 25 16:53:50 user nova-compute[70659]:       </nova:ports>
Jul 25 16:53:50 user nova-compute[70659]:     </nova:instance>
Jul 25 16:53:50 user nova-compute[70659]:   </metadata>
Jul 25 16:53:50 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:53:50 user nova-compute[70659]:     <system>
Jul 25 16:53:50 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:53:50 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:53:50 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:53:50 user nova-compute[70659]:       <entry name="serial">9df22b5f-c0e3-4eb5-9054-c593d0660ee5</entry>
Jul 25 16:53:50 user nova-compute[70659]:       <entry name="uuid">9df22b5f-c0e3-4eb5-9054-c593d0660ee5</entry>
Jul 25 16:53:50 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:53:50 user nova-compute[70659]:     </system>
Jul 25 16:53:50 user nova-compute[70659]:   </sysinfo>
Jul 25 16:53:50 user nova-compute[70659]:   <os>
Jul 25 16:53:50 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:53:50 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:53:50 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:53:50 user nova-compute[70659]:   </os>
Jul 25 16:53:50 user nova-compute[70659]:   <features>
Jul 25 16:53:50 user nova-compute[70659]:     <acpi/>
Jul 25 16:53:50 user nova-compute[70659]:     <apic/>
Jul 25 16:53:50 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:53:50 user nova-compute[70659]:   </features>
Jul 25 16:53:50 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:53:50 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:53:50 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:53:50 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:53:50 user nova-compute[70659]:   </clock>
Jul 25 16:53:50 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:53:50 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:53:50 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:53:50 user nova-compute[70659]:   </cpu>
Jul 25 16:53:50 user nova-compute[70659]:   <devices>
Jul 25 16:53:50 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:53:50 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:53:50 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk"/>
Jul 25 16:53:50 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:53:50 user nova-compute[70659]:     </disk>
Jul 25 16:53:50 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:53:50 user nova-compute[70659]:       <mac address="fa:16:3e:ea:f3:27"/>
Jul 25 16:53:50 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:53:50 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:53:50 user nova-compute[70659]:       <target dev="tap3c7f2734-73"/>
Jul 25 16:53:50 user nova-compute[70659]:     </interface>
Jul 25 16:53:50 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:53:50 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/console.log" append="off"/>
Jul 25 16:53:50 user nova-compute[70659]:     </serial>
Jul 25 16:53:50 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:53:50 user nova-compute[70659]:     <video>
Jul 25 16:53:50 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:53:50 user nova-compute[70659]:     </video>
Jul 25 16:53:50 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:53:50 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:53:50 user nova-compute[70659]:     </rng>
Jul 25 16:53:50 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:53:50 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:53:50 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:53:50 user nova-compute[70659]:     </memballoon>
Jul 25 16:53:50 user nova-compute[70659]:   </devices>
Jul 25 16:53:50 user nova-compute[70659]: </domain>
Jul 25 16:53:50 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:50 user nova-compute[70659]: INFO nova.compute.manager [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Detaching volume a91b2e0d-cb1b-4adf-9496-8bfcff4e4470
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:53:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: INFO nova.virt.block_device [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Attempting to driver detach volume a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 from mountpoint /dev/vdb
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Attempting to detach device vdb from instance 743875b3-2013-4162-9940-f1f59ca6c7f6 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:53:51 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:53:51 user nova-compute[70659]:   <source dev="/dev/sdc"/>
Jul 25 16:53:51 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:53:51 user nova-compute[70659]:   <serial>a91b2e0d-cb1b-4adf-9496-8bfcff4e4470</serial>
Jul 25 16:53:51 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:53:51 user nova-compute[70659]: </disk>
Jul 25 16:53:51 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Cannot resize image /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'migration_context' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:51 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Successfully detached device vdb from instance 743875b3-2013-4162-9940-f1f59ca6c7f6 from the persistent domain config.
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 743875b3-2013-4162-9940-f1f59ca6c7f6 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:53:51 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:53:51 user nova-compute[70659]:   <source dev="/dev/sdc"/>
Jul 25 16:53:51 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:53:51 user nova-compute[70659]:   <serial>a91b2e0d-cb1b-4adf-9496-8bfcff4e4470</serial>
Jul 25 16:53:51 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:53:51 user nova-compute[70659]: </disk>
Jul 25 16:53:51 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252348890',display_name='tempest-AttachVolumeTestJSON-server-1252348890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252348890',id=5,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl7hEIoOzploaaVJzvHH8s9XWd3DqHJQDS4RGFYYAnouMce0kg5Qq6bJLKJ1xPuEcKILYqVCIIw7SRQhcjnOOD1emebVM/xSSTVD/YqNbIqjFDTdfW8AR1dAleT+Ed0Qw==',key_name='tempest-keypair-1208202396',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-dwrzw3y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:51:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=9df22b5f-c0e3-4eb5-9054-c593d0660ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_vif [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c7f2734-73, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c7f2734-73, col_values=(('external_ids', {'iface-id': '3c7f2734-73c4-4648-a080-0ea25238dad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:f3:27', 'vm-uuid': '9df22b5f-c0e3-4eb5-9054-c593d0660ee5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:51 user nova-compute[70659]: INFO os_vif [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73')
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304031.8727748, 743875b3-2013-4162-9940-f1f59ca6c7f6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 743875b3-2013-4162-9940-f1f59ca6c7f6 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:53:51 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Successfully detached device vdb from instance 743875b3-2013-4162-9940-f1f59ca6c7f6 from the live domain config.
Jul 25 16:53:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHQYayuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:53:51 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccc0b4e-7319-44a4-a175-8fc1fe990ea9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7645f3ac-4616-47f3-87ff-2ae8471d9efb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:53:51 user nova-compute[70659]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 (non-flash)
Jul 25 16:53:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:53:51 user nova-compute[70659]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 (non-flash)
Jul 25 16:53:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30501cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470'): ({'sdc'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Removing single pathed devices sdc {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac8b503-f87a-4761-9caa-cf8cd015b009]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f91e45-d014-405d-b5ae-fcb43a9d9e91]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Flushing IO for device /dev/sdc {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b48a3c-6fed-4bd6-a2ae-810376873f57]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:53:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a15d514-7599-4e4c-b15b-e60177dc6bed]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[87710997-3b20-4921-b553-76203f20f395]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dc7bfb-a2bf-4929-9b37-aa7425fe8d13]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470, portal: 172.16.0.220,3260]
Jul 25 16:53:52 user nova-compute[70659]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470, portal: 172.16.0.220,3260] successful.
Jul 25 16:53:52 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91b2e0d-cb1b-4adf-9496-8bfcff4e4470 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[01409593-ad05-449b-8103-8189150d6137]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] <== disconnect_volume: return (259ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lazy-loading 'flavor' on Instance uuid 743875b3-2013-4162-9940-f1f59ca6c7f6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c20d71a-2c12-419d-9f38-452aeb2eca90 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.987s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG nova.compute.manager [req-8e2e1a9b-4989-48c5-b4cd-8f4aacf7c306 req-aca7affb-f9d7-422f-8132-63166c397baf service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8e2e1a9b-4989-48c5-b4cd-8f4aacf7c306 req-aca7affb-f9d7-422f-8132-63166c397baf service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8e2e1a9b-4989-48c5-b4cd-8f4aacf7c306 req-aca7affb-f9d7-422f-8132-63166c397baf service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8e2e1a9b-4989-48c5-b4cd-8f4aacf7c306 req-aca7affb-f9d7-422f-8132-63166c397baf service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG nova.compute.manager [req-8e2e1a9b-4989-48c5-b4cd-8f4aacf7c306 req-aca7affb-f9d7-422f-8132-63166c397baf service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:53:53 user nova-compute[70659]: WARNING nova.compute.manager [req-8e2e1a9b-4989-48c5-b4cd-8f4aacf7c306 req-aca7affb-f9d7-422f-8132-63166c397baf service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state stopped and task_state powering-on.
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:53:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304035.0727227, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:53:55 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] VM Resumed (Lifecycle Event)
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-e2918720-33c3-4912-8e2f-b54881378052 req-f435c5ac-0538-4867-b828-b98a08db4324 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e2918720-33c3-4912-8e2f-b54881378052 req-f435c5ac-0538-4867-b828-b98a08db4324 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e2918720-33c3-4912-8e2f-b54881378052 req-f435c5ac-0538-4867-b828-b98a08db4324 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e2918720-33c3-4912-8e2f-b54881378052 req-f435c5ac-0538-4867-b828-b98a08db4324 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-e2918720-33c3-4912-8e2f-b54881378052 req-f435c5ac-0538-4867-b828-b98a08db4324 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:53:55 user nova-compute[70659]: WARNING nova.compute.manager [req-e2918720-33c3-4912-8e2f-b54881378052 req-f435c5ac-0538-4867-b828-b98a08db4324 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state stopped and task_state powering-on.
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:55 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:55 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7211MB free_disk=25.40020751953125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:53:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance rebooted successfully.
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d031551f-ae2d-4ddc-906c-e9244e421176 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:53:55 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304035.0739546, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:53:55 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] VM Started (Lifecycle Event)
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 743875b3-2013-4162-9940-f1f59ca6c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e9edc2a1-bdba-491c-820d-7a805e268bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 1e549abb-40d8-42d6-ae8f-508d5c13be89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f6fba6f6-ff72-43c2-b824-f262bf430eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f201428e-c462-4cf2-881c-6712801f2e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:53:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:53:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:53:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:53:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 16:53:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:53:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:54:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "73980900-2093-4338-8460-d91df2e2709d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:54:03 user nova-compute[70659]: INFO nova.compute.claims [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Claim successful on node user
Jul 25 16:54:03 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:54:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:54:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:54:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:54:03 user nova-compute[70659]: INFO nova.virt.block_device [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Booting with blank volume at /dev/vda
Jul 25 16:54:03 user nova-compute[70659]: DEBUG nova.policy [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '913d51a0ff3746c5bdadd59fdf14e787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef5ee6f08d04772994840a8973da621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:54:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Successfully created port: 46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Successfully updated port: 46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquired lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-9ac93168-0829-42c0-8777-773961f9957f req-86f6e755-b174-4176-b756-5563f8e3cee4 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-changed-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-9ac93168-0829-42c0-8777-773961f9957f req-86f6e755-b174-4176-b756-5563f8e3cee4 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Refreshing instance network info cache due to event network-changed-46fdf795-f2fd-419b-96b3-9c45c3fe9a44. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9ac93168-0829-42c0-8777-773961f9957f req-86f6e755-b174-4176-b756-5563f8e3cee4 service nova] Acquiring lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updating instance_info_cache with network_info: [{"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Releasing lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Instance network_info: |[{"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9ac93168-0829-42c0-8777-773961f9957f req-86f6e755-b174-4176-b756-5563f8e3cee4 service nova] Acquired lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:05 user nova-compute[70659]: DEBUG nova.network.neutron [req-9ac93168-0829-42c0-8777-773961f9957f req-86f6e755-b174-4176-b756-5563f8e3cee4 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Refreshing network info cache for port 46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:54:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-9ac93168-0829-42c0-8777-773961f9957f req-86f6e755-b174-4176-b756-5563f8e3cee4 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updated VIF entry in instance network info cache for port 46fdf795-f2fd-419b-96b3-9c45c3fe9a44. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:54:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-9ac93168-0829-42c0-8777-773961f9957f req-86f6e755-b174-4176-b756-5563f8e3cee4 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updating instance_info_cache with network_info: [{"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9ac93168-0829-42c0-8777-773961f9957f req-86f6e755-b174-4176-b756-5563f8e3cee4 service nova] Releasing lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG os_brick.utils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6953c5c-b939-49e2-854d-c7ec8f13060a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f609a-3b5b-4773-b7f2-cd8852b2681e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[04979c29-6641-4cb2-8e60-626914bd99e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334aff0-5385-4480-8c33-38a2e56ffd25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:54:09 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:54:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2ae09b-360a-4644-92b5-91f20c4edecf]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG os_brick.utils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:54:09 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updating existing volume attachment record: 58190ca5-465b-42fa-950c-848b3c284ccd {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:54:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:54:16 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Creating image(s)
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Ensure instance console log exists: /opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Start _get_guest_xml network_info=[{"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '58190ca5-465b-42fa-950c-848b3c284ccd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgyGcDmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73980900-2093-4338-8460-d91df2e2709d', 'attached_at': '', 'detached_at': '', 'volume_id': '929c72cf-3ffe-49a9-b089-888195ea9970', 'serial': '929c72cf-3ffe-49a9-b089-888195ea9970'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:54:16 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:16 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgyGcDmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:54:16 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:54:16 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:54:16 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[561557fc-26cb-4c12-9c72-e0f74e506fbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:54:16 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3681e616-5c5e-4483-b6c8-98bd98a06e63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970] added
Jul 25 16:54:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e937f563-69ec-43d6-a9eb-9109c6069e62]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[21293c5f-95dd-4aed-8e98-3b58042aa0c2]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PgyGcDmz {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PgyGcDmz" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a8d93c-4342-433e-8752-f44b86000205]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PgyGcDmz'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4420ddcd-8f34-4f7f-98dd-55e29ddbde24]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a336331-cc75-44bd-8271-c9595ece4369]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:54:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:54:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf32b42-1d8b-4a8e-8423-441a44598c8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970, portal: 172.16.0.220,3260]
Jul 25 16:54:16 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970, portal: 172.16.0.220,3260] successful.
Jul 25 16:54:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed87ca83-3256-4992-9286-5d5f62b96421]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95ca1ef-b2e0-4bdb-a079-ea1d495468a8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:54:16 user nova-compute[70659]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:54:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:54:16 user nova-compute[70659]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:54:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[945ef33e-df9e-4b8a-a119-93651bed4447]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgyGcDmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:54:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23062363261376230', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062363261376230', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1788636919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1788636919',id=21,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-5jvc40sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:04Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=73980900-2093-4338-8460-d91df2e2709d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:fd:9a,bridge_name='br-int',has_traffic_filtering=True,id=46fdf795-f2fd-419b-96b3-9c45c3fe9a44,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46fdf795-f2') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'pci_devices' on Instance uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:54:17 user nova-compute[70659]:   <uuid>73980900-2093-4338-8460-d91df2e2709d</uuid>
Jul 25 16:54:17 user nova-compute[70659]:   <name>instance-00000015</name>
Jul 25 16:54:17 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:54:17 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:54:17 user nova-compute[70659]:   <metadata>
Jul 25 16:54:17 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:54:17 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:54:17 user nova-compute[70659]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1788636919</nova:name>
Jul 25 16:54:17 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:54:16</nova:creationTime>
Jul 25 16:54:17 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:54:17 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:54:17 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:54:17 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:54:17 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:54:17 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:54:17 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:54:17 user nova-compute[70659]:       <nova:owner>
Jul 25 16:54:17 user nova-compute[70659]:         <nova:user uuid="913d51a0ff3746c5bdadd59fdf14e787">tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member</nova:user>
Jul 25 16:54:17 user nova-compute[70659]:         <nova:project uuid="1ef5ee6f08d04772994840a8973da621">tempest-ServerBootFromVolumeStableRescueTest-191665891</nova:project>
Jul 25 16:54:17 user nova-compute[70659]:       </nova:owner>
Jul 25 16:54:17 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:54:17 user nova-compute[70659]:       <nova:ports>
Jul 25 16:54:17 user nova-compute[70659]:         <nova:port uuid="46fdf795-f2fd-419b-96b3-9c45c3fe9a44">
Jul 25 16:54:17 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 16:54:17 user nova-compute[70659]:         </nova:port>
Jul 25 16:54:17 user nova-compute[70659]:       </nova:ports>
Jul 25 16:54:17 user nova-compute[70659]:     </nova:instance>
Jul 25 16:54:17 user nova-compute[70659]:   </metadata>
Jul 25 16:54:17 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:54:17 user nova-compute[70659]:     <system>
Jul 25 16:54:17 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:54:17 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:54:17 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:54:17 user nova-compute[70659]:       <entry name="serial">73980900-2093-4338-8460-d91df2e2709d</entry>
Jul 25 16:54:17 user nova-compute[70659]:       <entry name="uuid">73980900-2093-4338-8460-d91df2e2709d</entry>
Jul 25 16:54:17 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:54:17 user nova-compute[70659]:     </system>
Jul 25 16:54:17 user nova-compute[70659]:   </sysinfo>
Jul 25 16:54:17 user nova-compute[70659]:   <os>
Jul 25 16:54:17 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:54:17 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:54:17 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:54:17 user nova-compute[70659]:   </os>
Jul 25 16:54:17 user nova-compute[70659]:   <features>
Jul 25 16:54:17 user nova-compute[70659]:     <acpi/>
Jul 25 16:54:17 user nova-compute[70659]:     <apic/>
Jul 25 16:54:17 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:54:17 user nova-compute[70659]:   </features>
Jul 25 16:54:17 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:54:17 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:54:17 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:54:17 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:54:17 user nova-compute[70659]:   </clock>
Jul 25 16:54:17 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:54:17 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:54:17 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:54:17 user nova-compute[70659]:   </cpu>
Jul 25 16:54:17 user nova-compute[70659]:   <devices>
Jul 25 16:54:17 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:54:17 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:54:17 user nova-compute[70659]:       <source dev="/dev/sdc"/>
Jul 25 16:54:17 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:54:17 user nova-compute[70659]:       <serial>929c72cf-3ffe-49a9-b089-888195ea9970</serial>
Jul 25 16:54:17 user nova-compute[70659]:     </disk>
Jul 25 16:54:17 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:54:17 user nova-compute[70659]:       <mac address="fa:16:3e:27:fd:9a"/>
Jul 25 16:54:17 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:54:17 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:54:17 user nova-compute[70659]:       <target dev="tap46fdf795-f2"/>
Jul 25 16:54:17 user nova-compute[70659]:     </interface>
Jul 25 16:54:17 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:54:17 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/console.log" append="off"/>
Jul 25 16:54:17 user nova-compute[70659]:     </serial>
Jul 25 16:54:17 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:54:17 user nova-compute[70659]:     <video>
Jul 25 16:54:17 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:54:17 user nova-compute[70659]:     </video>
Jul 25 16:54:17 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:54:17 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:54:17 user nova-compute[70659]:     </rng>
Jul 25 16:54:17 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:54:17 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:54:17 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:54:17 user nova-compute[70659]:     </memballoon>
Jul 25 16:54:17 user nova-compute[70659]:   </devices>
Jul 25 16:54:17 user nova-compute[70659]: </domain>
Jul 25 16:54:17 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1788636919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1788636919',id=21,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-5jvc40sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:04Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=73980900-2093-4338-8460-d91df2e2709d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:fd:9a,bridge_name='br-int',has_traffic_filtering=True,id=46fdf795-f2fd-419b-96b3-9c45c3fe9a44,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46fdf795-f2') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG os_vif [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:fd:9a,bridge_name='br-int',has_traffic_filtering=True,id=46fdf795-f2fd-419b-96b3-9c45c3fe9a44,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46fdf795-f2') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46fdf795-f2, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46fdf795-f2, col_values=(('external_ids', {'iface-id': '46fdf795-f2fd-419b-96b3-9c45c3fe9a44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:fd:9a', 'vm-uuid': '73980900-2093-4338-8460-d91df2e2709d'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:17 user nova-compute[70659]: INFO os_vif [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:fd:9a,bridge_name='br-int',has_traffic_filtering=True,id=46fdf795-f2fd-419b-96b3-9c45c3fe9a44,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46fdf795-f2')
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:54:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No VIF found with MAC fa:16:3e:27:fd:9a, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:54:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:54:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:18 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:54:18 user nova-compute[70659]: INFO nova.compute.claims [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Claim successful on node user
Jul 25 16:54:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-f3f37b27-63d0-46ca-9332-23712a2e4c76 req-a5b59248-feac-41f1-bce2-e6578f5aa1b9 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f3f37b27-63d0-46ca-9332-23712a2e4c76 req-a5b59248-feac-41f1-bce2-e6578f5aa1b9 service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f3f37b27-63d0-46ca-9332-23712a2e4c76 req-a5b59248-feac-41f1-bce2-e6578f5aa1b9 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f3f37b27-63d0-46ca-9332-23712a2e4c76 req-a5b59248-feac-41f1-bce2-e6578f5aa1b9 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-f3f37b27-63d0-46ca-9332-23712a2e4c76 req-a5b59248-feac-41f1-bce2-e6578f5aa1b9 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:19 user nova-compute[70659]: WARNING nova.compute.manager [req-f3f37b27-63d0-46ca-9332-23712a2e4c76 req-a5b59248-feac-41f1-bce2-e6578f5aa1b9 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state building and task_state spawning.
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.network.neutron [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:54:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.policy [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa556ea48af74f00887d740c81841879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa968e78b2f4b8eac3f96aefa36aa4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:54:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Creating image(s)
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "/opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "/opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "/opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk 1073741824" returned: 0 in 0.058s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Successfully created port: 659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Cannot resize image /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG nova.objects.instance [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lazy-loading 'migration_context' on Instance uuid 6abb7439-ca84-4a8e-b444-d1a24fe07fde {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Ensure instance console log exists: /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Successfully updated port: 659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "refresh_cache-6abb7439-ca84-4a8e-b444-d1a24fe07fde" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquired lock "refresh_cache-6abb7439-ca84-4a8e-b444-d1a24fe07fde" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-fe2faf91-0a24-44ce-a3c9-512c1ec40d7f req-c47ba8ec-2802-41fb-aadd-2044c5c8e0c4 service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received event network-changed-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-fe2faf91-0a24-44ce-a3c9-512c1ec40d7f req-c47ba8ec-2802-41fb-aadd-2044c5c8e0c4 service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Refreshing instance network info cache due to event network-changed-659cda7f-6022-4c6d-b182-dd720257de0a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fe2faf91-0a24-44ce-a3c9-512c1ec40d7f req-c47ba8ec-2802-41fb-aadd-2044c5c8e0c4 service nova] Acquiring lock "refresh_cache-6abb7439-ca84-4a8e-b444-d1a24fe07fde" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304061.0910347, 73980900-2093-4338-8460-d91df2e2709d => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:21 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] VM Resumed (Lifecycle Event)
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:54:21 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] Instance spawned successfully.
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:21 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304061.0915112, 73980900-2093-4338-8460-d91df2e2709d => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:21 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] VM Started (Lifecycle Event)
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:54:21 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:54:21 user nova-compute[70659]: INFO nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Took 4.94 seconds to spawn the instance on the hypervisor.
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:21 user nova-compute[70659]: INFO nova.compute.manager [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Took 18.16 seconds to build instance.
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfb7bc3d-3594-4077-93c6-350781b1f9f4 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "73980900-2093-4338-8460-d91df2e2709d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.260s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-d10d9921-aacc-4c40-87c7-b3362d08476e req-df9de8e7-2c5b-4304-ba5e-7ae8d899f438 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d10d9921-aacc-4c40-87c7-b3362d08476e req-df9de8e7-2c5b-4304-ba5e-7ae8d899f438 service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d10d9921-aacc-4c40-87c7-b3362d08476e req-df9de8e7-2c5b-4304-ba5e-7ae8d899f438 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d10d9921-aacc-4c40-87c7-b3362d08476e req-df9de8e7-2c5b-4304-ba5e-7ae8d899f438 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-d10d9921-aacc-4c40-87c7-b3362d08476e req-df9de8e7-2c5b-4304-ba5e-7ae8d899f438 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:21 user nova-compute[70659]: WARNING nova.compute.manager [req-d10d9921-aacc-4c40-87c7-b3362d08476e req-df9de8e7-2c5b-4304-ba5e-7ae8d899f438 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state active and task_state None.
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Updating instance_info_cache with network_info: [{"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Releasing lock "refresh_cache-6abb7439-ca84-4a8e-b444-d1a24fe07fde" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Instance network_info: |[{"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fe2faf91-0a24-44ce-a3c9-512c1ec40d7f req-c47ba8ec-2802-41fb-aadd-2044c5c8e0c4 service nova] Acquired lock "refresh_cache-6abb7439-ca84-4a8e-b444-d1a24fe07fde" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-fe2faf91-0a24-44ce-a3c9-512c1ec40d7f req-c47ba8ec-2802-41fb-aadd-2044c5c8e0c4 service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Refreshing network info cache for port 659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Start _get_guest_xml network_info=[{"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:54:21 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:21 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1036882410',display_name='tempest-VolumesActionsTest-instance-1036882410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1036882410',id=22,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fa968e78b2f4b8eac3f96aefa36aa4b',ramdisk_id='',reservation_id='r-j1d9l49z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-848179361',owner_user_name='tempest-VolumesActionsTest-848179361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:20Z,user_data=None,user_id='fa556ea48af74f00887d740c81841879',uuid=6abb7439-ca84-4a8e-b444-d1a24fe07fde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converting VIF {"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:df,bridge_name='br-int',has_traffic_filtering=True,id=659cda7f-6022-4c6d-b182-dd720257de0a,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659cda7f-60') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.objects.instance [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lazy-loading 'pci_devices' on Instance uuid 6abb7439-ca84-4a8e-b444-d1a24fe07fde {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:54:21 user nova-compute[70659]:   <uuid>6abb7439-ca84-4a8e-b444-d1a24fe07fde</uuid>
Jul 25 16:54:21 user nova-compute[70659]:   <name>instance-00000016</name>
Jul 25 16:54:21 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:54:21 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:54:21 user nova-compute[70659]:   <metadata>
Jul 25 16:54:21 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:54:21 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:54:21 user nova-compute[70659]:       <nova:name>tempest-VolumesActionsTest-instance-1036882410</nova:name>
Jul 25 16:54:21 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:54:21</nova:creationTime>
Jul 25 16:54:21 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:54:21 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:54:21 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:54:21 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:54:21 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:54:21 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:54:21 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:54:21 user nova-compute[70659]:       <nova:owner>
Jul 25 16:54:21 user nova-compute[70659]:         <nova:user uuid="fa556ea48af74f00887d740c81841879">tempest-VolumesActionsTest-848179361-project-member</nova:user>
Jul 25 16:54:21 user nova-compute[70659]:         <nova:project uuid="5fa968e78b2f4b8eac3f96aefa36aa4b">tempest-VolumesActionsTest-848179361</nova:project>
Jul 25 16:54:21 user nova-compute[70659]:       </nova:owner>
Jul 25 16:54:21 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:54:21 user nova-compute[70659]:       <nova:ports>
Jul 25 16:54:21 user nova-compute[70659]:         <nova:port uuid="659cda7f-6022-4c6d-b182-dd720257de0a">
Jul 25 16:54:21 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 16:54:21 user nova-compute[70659]:         </nova:port>
Jul 25 16:54:21 user nova-compute[70659]:       </nova:ports>
Jul 25 16:54:21 user nova-compute[70659]:     </nova:instance>
Jul 25 16:54:21 user nova-compute[70659]:   </metadata>
Jul 25 16:54:21 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:54:21 user nova-compute[70659]:     <system>
Jul 25 16:54:21 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:54:21 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:54:21 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:54:21 user nova-compute[70659]:       <entry name="serial">6abb7439-ca84-4a8e-b444-d1a24fe07fde</entry>
Jul 25 16:54:21 user nova-compute[70659]:       <entry name="uuid">6abb7439-ca84-4a8e-b444-d1a24fe07fde</entry>
Jul 25 16:54:21 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:54:21 user nova-compute[70659]:     </system>
Jul 25 16:54:21 user nova-compute[70659]:   </sysinfo>
Jul 25 16:54:21 user nova-compute[70659]:   <os>
Jul 25 16:54:21 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:54:21 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:54:21 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:54:21 user nova-compute[70659]:   </os>
Jul 25 16:54:21 user nova-compute[70659]:   <features>
Jul 25 16:54:21 user nova-compute[70659]:     <acpi/>
Jul 25 16:54:21 user nova-compute[70659]:     <apic/>
Jul 25 16:54:21 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:54:21 user nova-compute[70659]:   </features>
Jul 25 16:54:21 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:54:21 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:54:21 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:54:21 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:54:21 user nova-compute[70659]:   </clock>
Jul 25 16:54:21 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:54:21 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:54:21 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:54:21 user nova-compute[70659]:   </cpu>
Jul 25 16:54:21 user nova-compute[70659]:   <devices>
Jul 25 16:54:21 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:54:21 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:54:21 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk"/>
Jul 25 16:54:21 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:54:21 user nova-compute[70659]:     </disk>
Jul 25 16:54:21 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:54:21 user nova-compute[70659]:       <mac address="fa:16:3e:52:b6:df"/>
Jul 25 16:54:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:54:21 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:54:21 user nova-compute[70659]:       <target dev="tap659cda7f-60"/>
Jul 25 16:54:21 user nova-compute[70659]:     </interface>
Jul 25 16:54:21 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:54:21 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/console.log" append="off"/>
Jul 25 16:54:21 user nova-compute[70659]:     </serial>
Jul 25 16:54:21 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:54:21 user nova-compute[70659]:     <video>
Jul 25 16:54:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:54:21 user nova-compute[70659]:     </video>
Jul 25 16:54:21 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:54:21 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:54:21 user nova-compute[70659]:     </rng>
Jul 25 16:54:21 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:54:21 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:54:21 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:54:21 user nova-compute[70659]:     </memballoon>
Jul 25 16:54:21 user nova-compute[70659]:   </devices>
Jul 25 16:54:21 user nova-compute[70659]: </domain>
Jul 25 16:54:21 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1036882410',display_name='tempest-VolumesActionsTest-instance-1036882410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1036882410',id=22,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fa968e78b2f4b8eac3f96aefa36aa4b',ramdisk_id='',reservation_id='r-j1d9l49z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-848179361',owner_user_name='tempest-VolumesActionsTest-848179361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:20Z,user_data=None,user_id='fa556ea48af74f00887d740c81841879',uuid=6abb7439-ca84-4a8e-b444-d1a24fe07fde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converting VIF {"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:df,bridge_name='br-int',has_traffic_filtering=True,id=659cda7f-6022-4c6d-b182-dd720257de0a,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659cda7f-60') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG os_vif [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:df,bridge_name='br-int',has_traffic_filtering=True,id=659cda7f-6022-4c6d-b182-dd720257de0a,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659cda7f-60') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap659cda7f-60, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap659cda7f-60, col_values=(('external_ids', {'iface-id': '659cda7f-6022-4c6d-b182-dd720257de0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:b6:df', 'vm-uuid': '6abb7439-ca84-4a8e-b444-d1a24fe07fde'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:21 user nova-compute[70659]: INFO os_vif [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:df,bridge_name='br-int',has_traffic_filtering=True,id=659cda7f-6022-4c6d-b182-dd720257de0a,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659cda7f-60')
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] No VIF found with MAC fa:16:3e:52:b6:df, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-fe2faf91-0a24-44ce-a3c9-512c1ec40d7f req-c47ba8ec-2802-41fb-aadd-2044c5c8e0c4 service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Updated VIF entry in instance network info cache for port 659cda7f-6022-4c6d-b182-dd720257de0a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-fe2faf91-0a24-44ce-a3c9-512c1ec40d7f req-c47ba8ec-2802-41fb-aadd-2044c5c8e0c4 service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Updating instance_info_cache with network_info: [{"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fe2faf91-0a24-44ce-a3c9-512c1ec40d7f req-c47ba8ec-2802-41fb-aadd-2044c5c8e0c4 service nova] Releasing lock "refresh_cache-6abb7439-ca84-4a8e-b444-d1a24fe07fde" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-064427a3-de1a-4769-99be-5bc1bc846847 req-6915b9d4-a11c-4707-9246-bf6c0bce206e service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received event network-vif-plugged-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-064427a3-de1a-4769-99be-5bc1bc846847 req-6915b9d4-a11c-4707-9246-bf6c0bce206e service nova] Acquiring lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-064427a3-de1a-4769-99be-5bc1bc846847 req-6915b9d4-a11c-4707-9246-bf6c0bce206e service nova] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-064427a3-de1a-4769-99be-5bc1bc846847 req-6915b9d4-a11c-4707-9246-bf6c0bce206e service nova] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-064427a3-de1a-4769-99be-5bc1bc846847 req-6915b9d4-a11c-4707-9246-bf6c0bce206e service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] No waiting events found dispatching network-vif-plugged-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:23 user nova-compute[70659]: WARNING nova.compute.manager [req-064427a3-de1a-4769-99be-5bc1bc846847 req-6915b9d4-a11c-4707-9246-bf6c0bce206e service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received unexpected event network-vif-plugged-659cda7f-6022-4c6d-b182-dd720257de0a for instance with vm_state building and task_state spawning.
Jul 25 16:54:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304064.9246843, 6abb7439-ca84-4a8e-b444-d1a24fe07fde => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] VM Resumed (Lifecycle Event)
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:54:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Instance spawned successfully.
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:54:24 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304064.9275749, 6abb7439-ca84-4a8e-b444-d1a24fe07fde => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] VM Started (Lifecycle Event)
Jul 25 16:54:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:54:25 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:54:25 user nova-compute[70659]: INFO nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Took 5.38 seconds to spawn the instance on the hypervisor.
Jul 25 16:54:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:25 user nova-compute[70659]: INFO nova.compute.manager [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Took 6.26 seconds to build instance.
Jul 25 16:54:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-16beea8e-1c40-4365-ac7f-759a6e865f25 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.351s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-e7213064-921b-48a3-8e7b-38709ddd9f91 req-cb939d30-26f4-4c96-8bc2-256416099a48 service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received event network-vif-plugged-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e7213064-921b-48a3-8e7b-38709ddd9f91 req-cb939d30-26f4-4c96-8bc2-256416099a48 service nova] Acquiring lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e7213064-921b-48a3-8e7b-38709ddd9f91 req-cb939d30-26f4-4c96-8bc2-256416099a48 service nova] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e7213064-921b-48a3-8e7b-38709ddd9f91 req-cb939d30-26f4-4c96-8bc2-256416099a48 service nova] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-e7213064-921b-48a3-8e7b-38709ddd9f91 req-cb939d30-26f4-4c96-8bc2-256416099a48 service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] No waiting events found dispatching network-vif-plugged-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:25 user nova-compute[70659]: WARNING nova.compute.manager [req-e7213064-921b-48a3-8e7b-38709ddd9f91 req-cb939d30-26f4-4c96-8bc2-256416099a48 service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received unexpected event network-vif-plugged-659cda7f-6022-4c6d-b182-dd720257de0a for instance with vm_state active and task_state None.
Jul 25 16:54:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:54:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:30 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:54:30 user nova-compute[70659]: INFO nova.compute.claims [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Claim successful on node user
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.network.neutron [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:54:31 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.policy [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9aaa70e5cce7418b96837e30769ac6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20acc57667b418ba16f573fe81841ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:54:31 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Creating image(s)
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.131s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk 1073741824" returned: 0 in 0.044s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.129s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Cannot resize image /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.objects.instance [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'migration_context' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Ensure instance console log exists: /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Successfully created port: 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:54:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Successfully updated port: 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:54:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquired lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:54:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-c4da9558-b7df-44d7-a515-f339f5c5db81 req-e2fe0852-2fa4-4d68-b7cb-5822340fca3d service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-changed-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-c4da9558-b7df-44d7-a515-f339f5c5db81 req-e2fe0852-2fa4-4d68-b7cb-5822340fca3d service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Refreshing instance network info cache due to event network-changed-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:54:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4da9558-b7df-44d7-a515-f339f5c5db81 req-e2fe0852-2fa4-4d68-b7cb-5822340fca3d service nova] Acquiring lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.network.neutron [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating instance_info_cache with network_info: [{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Releasing lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Instance network_info: |[{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4da9558-b7df-44d7-a515-f339f5c5db81 req-e2fe0852-2fa4-4d68-b7cb-5822340fca3d service nova] Acquired lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-c4da9558-b7df-44d7-a515-f339f5c5db81 req-e2fe0852-2fa4-4d68-b7cb-5822340fca3d service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Refreshing network info cache for port 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Start _get_guest_xml network_info=[{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:54:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1644944333',display_name='tempest-ServerRescueNegativeTestJSON-server-1644944333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1644944333',id=23,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4jhIgOnxMQ5hodwDxhkvFAV/jzlx2MOi4HvSNeJhJQiQaz+EGM3gY5tYAvVpFFq2DgsXfMEUphY9/W2Cum8qMezySKtcW3KY6sqG6Ms5RpptV/IsBe9BWa/fEzK7lIfg==',key_name='tempest-keypair-1807504337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-ihgike6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=51c336bc-e646-4429-809d-354ae03bd8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:da:ad,bridge_name='br-int',has_traffic_filtering=True,id=5eb397f0-b9a0-4bb7-a2e7-47b497485cf2,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eb397f0-b9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'pci_devices' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:54:33 user nova-compute[70659]:   <uuid>51c336bc-e646-4429-809d-354ae03bd8d6</uuid>
Jul 25 16:54:33 user nova-compute[70659]:   <name>instance-00000017</name>
Jul 25 16:54:33 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:54:33 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:54:33 user nova-compute[70659]:   <metadata>
Jul 25 16:54:33 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:54:33 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:54:33 user nova-compute[70659]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1644944333</nova:name>
Jul 25 16:54:33 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:54:33</nova:creationTime>
Jul 25 16:54:33 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:54:33 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:54:33 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:54:33 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:54:33 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:54:33 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:54:33 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:54:33 user nova-compute[70659]:       <nova:owner>
Jul 25 16:54:33 user nova-compute[70659]:         <nova:user uuid="9aaa70e5cce7418b96837e30769ac6aa">tempest-ServerRescueNegativeTestJSON-1539045365-project-member</nova:user>
Jul 25 16:54:33 user nova-compute[70659]:         <nova:project uuid="d20acc57667b418ba16f573fe81841ac">tempest-ServerRescueNegativeTestJSON-1539045365</nova:project>
Jul 25 16:54:33 user nova-compute[70659]:       </nova:owner>
Jul 25 16:54:33 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:54:33 user nova-compute[70659]:       <nova:ports>
Jul 25 16:54:33 user nova-compute[70659]:         <nova:port uuid="5eb397f0-b9a0-4bb7-a2e7-47b497485cf2">
Jul 25 16:54:33 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 16:54:33 user nova-compute[70659]:         </nova:port>
Jul 25 16:54:33 user nova-compute[70659]:       </nova:ports>
Jul 25 16:54:33 user nova-compute[70659]:     </nova:instance>
Jul 25 16:54:33 user nova-compute[70659]:   </metadata>
Jul 25 16:54:33 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:54:33 user nova-compute[70659]:     <system>
Jul 25 16:54:33 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:54:33 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:54:33 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:54:33 user nova-compute[70659]:       <entry name="serial">51c336bc-e646-4429-809d-354ae03bd8d6</entry>
Jul 25 16:54:33 user nova-compute[70659]:       <entry name="uuid">51c336bc-e646-4429-809d-354ae03bd8d6</entry>
Jul 25 16:54:33 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:54:33 user nova-compute[70659]:     </system>
Jul 25 16:54:33 user nova-compute[70659]:   </sysinfo>
Jul 25 16:54:33 user nova-compute[70659]:   <os>
Jul 25 16:54:33 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:54:33 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:54:33 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:54:33 user nova-compute[70659]:   </os>
Jul 25 16:54:33 user nova-compute[70659]:   <features>
Jul 25 16:54:33 user nova-compute[70659]:     <acpi/>
Jul 25 16:54:33 user nova-compute[70659]:     <apic/>
Jul 25 16:54:33 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:54:33 user nova-compute[70659]:   </features>
Jul 25 16:54:33 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:54:33 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:54:33 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:54:33 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:54:33 user nova-compute[70659]:   </clock>
Jul 25 16:54:33 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:54:33 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:54:33 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:54:33 user nova-compute[70659]:   </cpu>
Jul 25 16:54:33 user nova-compute[70659]:   <devices>
Jul 25 16:54:33 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:54:33 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:54:33 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk"/>
Jul 25 16:54:33 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:54:33 user nova-compute[70659]:     </disk>
Jul 25 16:54:33 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:54:33 user nova-compute[70659]:       <mac address="fa:16:3e:e1:da:ad"/>
Jul 25 16:54:33 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:54:33 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:54:33 user nova-compute[70659]:       <target dev="tap5eb397f0-b9"/>
Jul 25 16:54:33 user nova-compute[70659]:     </interface>
Jul 25 16:54:33 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:54:33 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/console.log" append="off"/>
Jul 25 16:54:33 user nova-compute[70659]:     </serial>
Jul 25 16:54:33 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:54:33 user nova-compute[70659]:     <video>
Jul 25 16:54:33 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:54:33 user nova-compute[70659]:     </video>
Jul 25 16:54:33 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:54:33 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:54:33 user nova-compute[70659]:     </rng>
Jul 25 16:54:33 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:54:33 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:54:33 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:54:33 user nova-compute[70659]:     </memballoon>
Jul 25 16:54:33 user nova-compute[70659]:   </devices>
Jul 25 16:54:33 user nova-compute[70659]: </domain>
Jul 25 16:54:33 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1644944333',display_name='tempest-ServerRescueNegativeTestJSON-server-1644944333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1644944333',id=23,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4jhIgOnxMQ5hodwDxhkvFAV/jzlx2MOi4HvSNeJhJQiQaz+EGM3gY5tYAvVpFFq2DgsXfMEUphY9/W2Cum8qMezySKtcW3KY6sqG6Ms5RpptV/IsBe9BWa/fEzK7lIfg==',key_name='tempest-keypair-1807504337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-ihgike6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=51c336bc-e646-4429-809d-354ae03bd8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:da:ad,bridge_name='br-int',has_traffic_filtering=True,id=5eb397f0-b9a0-4bb7-a2e7-47b497485cf2,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eb397f0-b9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG os_vif [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:da:ad,bridge_name='br-int',has_traffic_filtering=True,id=5eb397f0-b9a0-4bb7-a2e7-47b497485cf2,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eb397f0-b9') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5eb397f0-b9, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5eb397f0-b9, col_values=(('external_ids', {'iface-id': '5eb397f0-b9a0-4bb7-a2e7-47b497485cf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:da:ad', 'vm-uuid': '51c336bc-e646-4429-809d-354ae03bd8d6'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:33 user nova-compute[70659]: INFO os_vif [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:da:ad,bridge_name='br-int',has_traffic_filtering=True,id=5eb397f0-b9a0-4bb7-a2e7-47b497485cf2,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eb397f0-b9')
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No VIF found with MAC fa:16:3e:e1:da:ad, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-c4da9558-b7df-44d7-a515-f339f5c5db81 req-e2fe0852-2fa4-4d68-b7cb-5822340fca3d service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updated VIF entry in instance network info cache for port 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-c4da9558-b7df-44d7-a515-f339f5c5db81 req-e2fe0852-2fa4-4d68-b7cb-5822340fca3d service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating instance_info_cache with network_info: [{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4da9558-b7df-44d7-a515-f339f5c5db81 req-e2fe0852-2fa4-4d68-b7cb-5822340fca3d service nova] Releasing lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac4a239e-a385-48a6-92cb-c0b354fb68ae req-67facb5d-a93f-4d13-9b35-4ded9f6e55ab service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac4a239e-a385-48a6-92cb-c0b354fb68ae req-67facb5d-a93f-4d13-9b35-4ded9f6e55ab service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac4a239e-a385-48a6-92cb-c0b354fb68ae req-67facb5d-a93f-4d13-9b35-4ded9f6e55ab service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac4a239e-a385-48a6-92cb-c0b354fb68ae req-67facb5d-a93f-4d13-9b35-4ded9f6e55ab service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac4a239e-a385-48a6-92cb-c0b354fb68ae req-67facb5d-a93f-4d13-9b35-4ded9f6e55ab service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:35 user nova-compute[70659]: WARNING nova.compute.manager [req-ac4a239e-a385-48a6-92cb-c0b354fb68ae req-67facb5d-a93f-4d13-9b35-4ded9f6e55ab service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state building and task_state spawning.
Jul 25 16:54:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304076.9336596, 51c336bc-e646-4429-809d-354ae03bd8d6 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:36 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] VM Resumed (Lifecycle Event)
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:54:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Instance spawned successfully.
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:36 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:54:36 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304076.935053, 51c336bc-e646-4429-809d-354ae03bd8d6 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:36 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] VM Started (Lifecycle Event)
Jul 25 16:54:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:54:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:54:37 user nova-compute[70659]: INFO nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Took 5.73 seconds to spawn the instance on the hypervisor.
Jul 25 16:54:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:37 user nova-compute[70659]: INFO nova.compute.manager [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Took 6.54 seconds to build instance.
Jul 25 16:54:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-be5b7f24-bdc3-43b3-971c-c4d0924eca7e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.706s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-f9801fb3-ae00-4cec-a213-ac76bab70ae2 req-c1ac7f3b-2d45-496b-8e25-bd8c303f5037 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9801fb3-ae00-4cec-a213-ac76bab70ae2 req-c1ac7f3b-2d45-496b-8e25-bd8c303f5037 service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9801fb3-ae00-4cec-a213-ac76bab70ae2 req-c1ac7f3b-2d45-496b-8e25-bd8c303f5037 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9801fb3-ae00-4cec-a213-ac76bab70ae2 req-c1ac7f3b-2d45-496b-8e25-bd8c303f5037 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-f9801fb3-ae00-4cec-a213-ac76bab70ae2 req-c1ac7f3b-2d45-496b-8e25-bd8c303f5037 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:37 user nova-compute[70659]: WARNING nova.compute.manager [req-f9801fb3-ae00-4cec-a213-ac76bab70ae2 req-c1ac7f3b-2d45-496b-8e25-bd8c303f5037 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state active and task_state None.
Jul 25 16:54:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:37 user nova-compute[70659]: INFO nova.compute.manager [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Terminating instance
Jul 25 16:54:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Instance destroyed successfully.
Jul 25 16:54:38 user nova-compute[70659]: DEBUG nova.objects.instance [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lazy-loading 'resources' on Instance uuid e9edc2a1-bdba-491c-820d-7a805e268bfb {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-82270984',display_name='tempest-VolumesNegativeTest-instance-82270984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-82270984',id=17,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:52:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5fde9e2b1f445c0befe2b486a11eb9f',ramdisk_id='',reservation_id='r-i4onutml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-121048916',owner_user_name='tempest-VolumesNegativeTest-121048916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:52:55Z,user_data=None,user_id='3e690b50640c468a8c34aa3295d451c2',uuid=e9edc2a1-bdba-491c-820d-7a805e268bfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Converting VIF {"id": "9ee6ea47-ad94-4648-a976-33679f2355e3", "address": "fa:16:3e:86:b2:54", "network": {"id": "fe011487-46ef-4541-a299-93c60d99c134", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a833a3f65d9d4559aaabe28a4cb1bd01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6ea47-ad", "ovs_interfaceid": "9ee6ea47-ad94-4648-a976-33679f2355e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b2:54,bridge_name='br-int',has_traffic_filtering=True,id=9ee6ea47-ad94-4648-a976-33679f2355e3,network=Network(fe011487-46ef-4541-a299-93c60d99c134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6ea47-ad') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG os_vif [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b2:54,bridge_name='br-int',has_traffic_filtering=True,id=9ee6ea47-ad94-4648-a976-33679f2355e3,network=Network(fe011487-46ef-4541-a299-93c60d99c134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6ea47-ad') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ee6ea47-ad, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: INFO os_vif [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b2:54,bridge_name='br-int',has_traffic_filtering=True,id=9ee6ea47-ad94-4648-a976-33679f2355e3,network=Network(fe011487-46ef-4541-a299-93c60d99c134),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6ea47-ad')
Jul 25 16:54:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Deleting instance files /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb_del
Jul 25 16:54:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Deletion of /opt/stack/data/nova/instances/e9edc2a1-bdba-491c-820d-7a805e268bfb_del complete
Jul 25 16:54:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:38 user nova-compute[70659]: INFO nova.compute.manager [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Took 1.09 seconds to destroy the instance on the hypervisor.
Jul 25 16:54:38 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:54:38 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-unplugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] No waiting events found dispatching network-vif-unplugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-unplugged-9ee6ea47-ad94-4648-a976-33679f2355e3 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] No waiting events found dispatching network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:39 user nova-compute[70659]: WARNING nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received unexpected event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 for instance with vm_state active and task_state deleting.
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] No waiting events found dispatching network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:39 user nova-compute[70659]: WARNING nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received unexpected event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 for instance with vm_state active and task_state deleting.
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] No waiting events found dispatching network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:39 user nova-compute[70659]: WARNING nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received unexpected event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 for instance with vm_state active and task_state deleting.
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-unplugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] No waiting events found dispatching network-vif-unplugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-07c1056a-3ab3-4f6d-af99-3d89ef17f37b req-13849ef8-23e4-45ae-8c66-b76669224099 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-unplugged-9ee6ea47-ad94-4648-a976-33679f2355e3 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:39 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:40 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Took 1.09 seconds to deallocate network for instance.
Jul 25 16:54:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-6276b542-6814-4abd-af25-8acf644bbad2 req-230fced0-ebd7-470f-8543-2c8d44902fc7 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-deleted-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:40 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:54:40 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:54:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:40 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Deleted allocations for instance e9edc2a1-bdba-491c-820d-7a805e268bfb
Jul 25 16:54:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-890a4341-98a0-4df3-bd40-0619fcf005ec tempest-VolumesNegativeTest-121048916 tempest-VolumesNegativeTest-121048916-project-member] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.811s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-1abefe88-e158-4e17-b473-0fcefe2b4371 req-a47fa336-dade-451e-b3c8-8162a1854c15 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1abefe88-e158-4e17-b473-0fcefe2b4371 req-a47fa336-dade-451e-b3c8-8162a1854c15 service nova] Acquiring lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1abefe88-e158-4e17-b473-0fcefe2b4371 req-a47fa336-dade-451e-b3c8-8162a1854c15 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1abefe88-e158-4e17-b473-0fcefe2b4371 req-a47fa336-dade-451e-b3c8-8162a1854c15 service nova] Lock "e9edc2a1-bdba-491c-820d-7a805e268bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-1abefe88-e158-4e17-b473-0fcefe2b4371 req-a47fa336-dade-451e-b3c8-8162a1854c15 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] No waiting events found dispatching network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:41 user nova-compute[70659]: WARNING nova.compute.manager [req-1abefe88-e158-4e17-b473-0fcefe2b4371 req-a47fa336-dade-451e-b3c8-8162a1854c15 service nova] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Received unexpected event network-vif-plugged-9ee6ea47-ad94-4648-a976-33679f2355e3 for instance with vm_state deleted and task_state None.
Jul 25 16:54:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:54:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:54:42 user nova-compute[70659]: INFO nova.compute.claims [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Claim successful on node user
Jul 25 16:54:42 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.network.neutron [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:54:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.policy [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a55ce1dcf3eb4f7da9ce20dbc7e432c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1548931d431b4da4859656f41b33a88c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:54:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Creating image(s)
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "/opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "/opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk 1073741824" returned: 0 in 0.047s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:43 user nova-compute[70659]: INFO nova.compute.manager [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Terminating instance
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Cannot resize image /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lazy-loading 'migration_context' on Instance uuid fc8e1bf8-976e-4c55-ad33-798cf40234e5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Ensure instance console log exists: /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Successfully created port: 1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f178e1e-42dd-4c34-af32-939f7a5314dc req-3d3cc195-e414-4da5-a5b0-fd832ea3c2d6 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-unplugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f178e1e-42dd-4c34-af32-939f7a5314dc req-3d3cc195-e414-4da5-a5b0-fd832ea3c2d6 service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f178e1e-42dd-4c34-af32-939f7a5314dc req-3d3cc195-e414-4da5-a5b0-fd832ea3c2d6 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f178e1e-42dd-4c34-af32-939f7a5314dc req-3d3cc195-e414-4da5-a5b0-fd832ea3c2d6 service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f178e1e-42dd-4c34-af32-939f7a5314dc req-3d3cc195-e414-4da5-a5b0-fd832ea3c2d6 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-unplugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f178e1e-42dd-4c34-af32-939f7a5314dc req-3d3cc195-e414-4da5-a5b0-fd832ea3c2d6 service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-unplugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:54:44 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Instance destroyed successfully.
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lazy-loading 'resources' on Instance uuid 5192b767-96f0-4789-ac74-0d6d6b5bef3e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1071496954',display_name='tempest-ServerActionsTestOtherB-server-1071496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1071496954',id=7,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWJlFb4j8Ys1CPB/bDiS40Ugcuw2Q/xoj3AvPfDyBBFFTZke2FjMd2/DfM6CM24MZfC34jM3nOUoDm3L0rcAn9FD/4h8gEUHn4G9Y2qb8q+bjHLww9szHUFjYPz7u30g==',key_name='tempest-keypair-329454245',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:52:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb25024c830544d682f76d9dc10171e2',ramdisk_id='',reservation_id='r-y1z79cx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1921270631',owner_user_name='tempest-ServerActionsTestOtherB-1921270631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:52:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ebfb3f4c65f4e16be5234a8a4e99e3c',uuid=5192b767-96f0-4789-ac74-0d6d6b5bef3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converting VIF {"id": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "address": "fa:16:3e:3b:ca:b5", "network": {"id": "a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-863559494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb25024c830544d682f76d9dc10171e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f746e90-8b", "ovs_interfaceid": "8f746e90-8b94-4b8c-8c13-02df5983ced0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_vif [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f746e90-8b, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:54:44 user nova-compute[70659]: INFO os_vif [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ca:b5,bridge_name='br-int',has_traffic_filtering=True,id=8f746e90-8b94-4b8c-8c13-02df5983ced0,network=Network(a320d339-cb6c-4a0d-ae2a-cd145bf4ad2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f746e90-8b')
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgFjEUbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:54:44 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4666c26-1cfa-4731-9587-6a92f05d1cde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e752ab8-6509-4e59-aeaf-289cd1f2d149]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:54:44 user nova-compute[70659]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:54:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add (non-flash)
Jul 25 16:54:44 user nova-compute[70659]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:54:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd28283eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbeae46-3794-446b-93ed-593f9bb79755]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bed7f00-14cb-4467-bcae-c6c4a6b5ecd4]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1e60ff-6b66-4768-8f8e-34cf1b152a10]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d96724-a7ff-4627-9090-d281a8537104]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b396506-d514-4db7-ab30-499c6a954317]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8354587c-6280-4e1d-beb9-16f93705e2b7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260]
Jul 25 16:54:44 user nova-compute[70659]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add, portal: 172.16.0.220,3260] successful.
Jul 25 16:54:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Successfully updated port: 1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42f574e-bafc-4e90-9fc2-f92970561add -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f33f11-00d5-4c00-86f9-036e1c854aa4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "refresh_cache-fc8e1bf8-976e-4c55-ad33-798cf40234e5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquired lock "refresh_cache-fc8e1bf8-976e-4c55-ad33-798cf40234e5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] <== disconnect_volume: return (278ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:54:44 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Deleting instance files /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e_del
Jul 25 16:54:44 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Deletion of /opt/stack/data/nova/instances/5192b767-96f0-4789-ac74-0d6d6b5bef3e_del complete
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-f3d8a097-22e4-430d-b6f0-307e8ec914f4 req-2b2c23b6-69c4-4149-8318-bcf83b895d6a service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received event network-changed-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-f3d8a097-22e4-430d-b6f0-307e8ec914f4 req-2b2c23b6-69c4-4149-8318-bcf83b895d6a service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Refreshing instance network info cache due to event network-changed-1041c77a-2c7a-4b34-86ae-a433671fd870. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:54:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f3d8a097-22e4-430d-b6f0-307e8ec914f4 req-2b2c23b6-69c4-4149-8318-bcf83b895d6a service nova] Acquiring lock "refresh_cache-fc8e1bf8-976e-4c55-ad33-798cf40234e5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.neutron [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:54:45 user nova-compute[70659]: INFO nova.compute.manager [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 25 16:54:45 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.neutron [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Updating instance_info_cache with network_info: [{"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Releasing lock "refresh_cache-fc8e1bf8-976e-4c55-ad33-798cf40234e5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Instance network_info: |[{"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f3d8a097-22e4-430d-b6f0-307e8ec914f4 req-2b2c23b6-69c4-4149-8318-bcf83b895d6a service nova] Acquired lock "refresh_cache-fc8e1bf8-976e-4c55-ad33-798cf40234e5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.neutron [req-f3d8a097-22e4-430d-b6f0-307e8ec914f4 req-2b2c23b6-69c4-4149-8318-bcf83b895d6a service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Refreshing network info cache for port 1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Start _get_guest_xml network_info=[{"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:54:45 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:45 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-763003661',display_name='tempest-VolumesAdminNegativeTest-server-763003661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-763003661',id=24,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1548931d431b4da4859656f41b33a88c',ramdisk_id='',reservation_id='r-qm2lo0nf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-863505829',owner_user_name='tempest-VolumesAdminNegativeTest-863505829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:43Z,user_data=None,user_id='a55ce1dcf3eb4f7da9ce20dbc7e432c0',uuid=fc8e1bf8-976e-4c55-ad33-798cf40234e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converting VIF {"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:31,bridge_name='br-int',has_traffic_filtering=True,id=1041c77a-2c7a-4b34-86ae-a433671fd870,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1041c77a-2c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.objects.instance [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lazy-loading 'pci_devices' on Instance uuid fc8e1bf8-976e-4c55-ad33-798cf40234e5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:54:45 user nova-compute[70659]:   <uuid>fc8e1bf8-976e-4c55-ad33-798cf40234e5</uuid>
Jul 25 16:54:45 user nova-compute[70659]:   <name>instance-00000018</name>
Jul 25 16:54:45 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:54:45 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:54:45 user nova-compute[70659]:   <metadata>
Jul 25 16:54:45 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:54:45 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:54:45 user nova-compute[70659]:       <nova:name>tempest-VolumesAdminNegativeTest-server-763003661</nova:name>
Jul 25 16:54:45 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:54:45</nova:creationTime>
Jul 25 16:54:45 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:54:45 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:54:45 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:54:45 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:54:45 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:54:45 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:54:45 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:54:45 user nova-compute[70659]:       <nova:owner>
Jul 25 16:54:45 user nova-compute[70659]:         <nova:user uuid="a55ce1dcf3eb4f7da9ce20dbc7e432c0">tempest-VolumesAdminNegativeTest-863505829-project-member</nova:user>
Jul 25 16:54:45 user nova-compute[70659]:         <nova:project uuid="1548931d431b4da4859656f41b33a88c">tempest-VolumesAdminNegativeTest-863505829</nova:project>
Jul 25 16:54:45 user nova-compute[70659]:       </nova:owner>
Jul 25 16:54:45 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:54:45 user nova-compute[70659]:       <nova:ports>
Jul 25 16:54:45 user nova-compute[70659]:         <nova:port uuid="1041c77a-2c7a-4b34-86ae-a433671fd870">
Jul 25 16:54:45 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 16:54:45 user nova-compute[70659]:         </nova:port>
Jul 25 16:54:45 user nova-compute[70659]:       </nova:ports>
Jul 25 16:54:45 user nova-compute[70659]:     </nova:instance>
Jul 25 16:54:45 user nova-compute[70659]:   </metadata>
Jul 25 16:54:45 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:54:45 user nova-compute[70659]:     <system>
Jul 25 16:54:45 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:54:45 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:54:45 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:54:45 user nova-compute[70659]:       <entry name="serial">fc8e1bf8-976e-4c55-ad33-798cf40234e5</entry>
Jul 25 16:54:45 user nova-compute[70659]:       <entry name="uuid">fc8e1bf8-976e-4c55-ad33-798cf40234e5</entry>
Jul 25 16:54:45 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:54:45 user nova-compute[70659]:     </system>
Jul 25 16:54:45 user nova-compute[70659]:   </sysinfo>
Jul 25 16:54:45 user nova-compute[70659]:   <os>
Jul 25 16:54:45 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:54:45 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:54:45 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:54:45 user nova-compute[70659]:   </os>
Jul 25 16:54:45 user nova-compute[70659]:   <features>
Jul 25 16:54:45 user nova-compute[70659]:     <acpi/>
Jul 25 16:54:45 user nova-compute[70659]:     <apic/>
Jul 25 16:54:45 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:54:45 user nova-compute[70659]:   </features>
Jul 25 16:54:45 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:54:45 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:54:45 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:54:45 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:54:45 user nova-compute[70659]:   </clock>
Jul 25 16:54:45 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:54:45 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:54:45 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:54:45 user nova-compute[70659]:   </cpu>
Jul 25 16:54:45 user nova-compute[70659]:   <devices>
Jul 25 16:54:45 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:54:45 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:54:45 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk"/>
Jul 25 16:54:45 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:54:45 user nova-compute[70659]:     </disk>
Jul 25 16:54:45 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:54:45 user nova-compute[70659]:       <mac address="fa:16:3e:3e:9e:31"/>
Jul 25 16:54:45 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:54:45 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:54:45 user nova-compute[70659]:       <target dev="tap1041c77a-2c"/>
Jul 25 16:54:45 user nova-compute[70659]:     </interface>
Jul 25 16:54:45 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:54:45 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/console.log" append="off"/>
Jul 25 16:54:45 user nova-compute[70659]:     </serial>
Jul 25 16:54:45 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:54:45 user nova-compute[70659]:     <video>
Jul 25 16:54:45 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:54:45 user nova-compute[70659]:     </video>
Jul 25 16:54:45 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:54:45 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:54:45 user nova-compute[70659]:     </rng>
Jul 25 16:54:45 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:54:45 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:54:45 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:54:45 user nova-compute[70659]:     </memballoon>
Jul 25 16:54:45 user nova-compute[70659]:   </devices>
Jul 25 16:54:45 user nova-compute[70659]: </domain>
Jul 25 16:54:45 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-763003661',display_name='tempest-VolumesAdminNegativeTest-server-763003661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-763003661',id=24,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1548931d431b4da4859656f41b33a88c',ramdisk_id='',reservation_id='r-qm2lo0nf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-863505829',owner_user_name='tempest-VolumesAdminNegativeTest-863505829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:43Z,user_data=None,user_id='a55ce1dcf3eb4f7da9ce20dbc7e432c0',uuid=fc8e1bf8-976e-4c55-ad33-798cf40234e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converting VIF {"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:31,bridge_name='br-int',has_traffic_filtering=True,id=1041c77a-2c7a-4b34-86ae-a433671fd870,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1041c77a-2c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG os_vif [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:31,bridge_name='br-int',has_traffic_filtering=True,id=1041c77a-2c7a-4b34-86ae-a433671fd870,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1041c77a-2c') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1041c77a-2c, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1041c77a-2c, col_values=(('external_ids', {'iface-id': '1041c77a-2c7a-4b34-86ae-a433671fd870', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:9e:31', 'vm-uuid': 'fc8e1bf8-976e-4c55-ad33-798cf40234e5'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:45 user nova-compute[70659]: INFO os_vif [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:31,bridge_name='br-int',has_traffic_filtering=True,id=1041c77a-2c7a-4b34-86ae-a433671fd870,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1041c77a-2c')
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] No VIF found with MAC fa:16:3e:3e:9e:31, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.neutron [req-f3d8a097-22e4-430d-b6f0-307e8ec914f4 req-2b2c23b6-69c4-4149-8318-bcf83b895d6a service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Updated VIF entry in instance network info cache for port 1041c77a-2c7a-4b34-86ae-a433671fd870. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.neutron [req-f3d8a097-22e4-430d-b6f0-307e8ec914f4 req-2b2c23b6-69c4-4149-8318-bcf83b895d6a service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Updating instance_info_cache with network_info: [{"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f3d8a097-22e4-430d-b6f0-307e8ec914f4 req-2b2c23b6-69c4-4149-8318-bcf83b895d6a service nova] Releasing lock "refresh_cache-fc8e1bf8-976e-4c55-ad33-798cf40234e5" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:45 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:45 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Took 0.91 seconds to deallocate network for instance.
Jul 25 16:54:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-703a01dc-fde5-45c8-b4c9-655951880e85 req-f0fafae9-d279-44a6-8725-9121df4f8c2c service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-703a01dc-fde5-45c8-b4c9-655951880e85 req-f0fafae9-d279-44a6-8725-9121df4f8c2c service nova] Acquiring lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-703a01dc-fde5-45c8-b4c9-655951880e85 req-f0fafae9-d279-44a6-8725-9121df4f8c2c service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-703a01dc-fde5-45c8-b4c9-655951880e85 req-f0fafae9-d279-44a6-8725-9121df4f8c2c service nova] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-703a01dc-fde5-45c8-b4c9-655951880e85 req-f0fafae9-d279-44a6-8725-9121df4f8c2c service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] No waiting events found dispatching network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:46 user nova-compute[70659]: WARNING nova.compute.manager [req-703a01dc-fde5-45c8-b4c9-655951880e85 req-f0fafae9-d279-44a6-8725-9121df4f8c2c service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received unexpected event network-vif-plugged-8f746e90-8b94-4b8c-8c13-02df5983ced0 for instance with vm_state active and task_state deleting.
Jul 25 16:54:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-703a01dc-fde5-45c8-b4c9-655951880e85 req-f0fafae9-d279-44a6-8725-9121df4f8c2c service nova] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Received event network-vif-deleted-8f746e90-8b94-4b8c-8c13-02df5983ced0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:46 user nova-compute[70659]: INFO nova.compute.manager [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Took 0.83 seconds to detach 1 volumes for instance.
Jul 25 16:54:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "1e549abb-40d8-42d6-ae8f-508d5c13be89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:47 user nova-compute[70659]: INFO nova.compute.manager [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Terminating instance
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-f351f759-7f03-48f8-ae69-cf9389967439 req-abb90d5c-484e-4bf0-ad6e-e65164bbd00e service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received event network-vif-plugged-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f351f759-7f03-48f8-ae69-cf9389967439 req-abb90d5c-484e-4bf0-ad6e-e65164bbd00e service nova] Acquiring lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f351f759-7f03-48f8-ae69-cf9389967439 req-abb90d5c-484e-4bf0-ad6e-e65164bbd00e service nova] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f351f759-7f03-48f8-ae69-cf9389967439 req-abb90d5c-484e-4bf0-ad6e-e65164bbd00e service nova] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-f351f759-7f03-48f8-ae69-cf9389967439 req-abb90d5c-484e-4bf0-ad6e-e65164bbd00e service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] No waiting events found dispatching network-vif-plugged-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:47 user nova-compute[70659]: WARNING nova.compute.manager [req-f351f759-7f03-48f8-ae69-cf9389967439 req-abb90d5c-484e-4bf0-ad6e-e65164bbd00e service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received unexpected event network-vif-plugged-1041c77a-2c7a-4b34-86ae-a433671fd870 for instance with vm_state building and task_state spawning.
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:47 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Deleted allocations for instance 5192b767-96f0-4789-ac74-0d6d6b5bef3e
Jul 25 16:54:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9358912f-4d91-470c-912a-2145bd14f249 tempest-ServerActionsTestOtherB-1921270631 tempest-ServerActionsTestOtherB-1921270631-project-member] Lock "5192b767-96f0-4789-ac74-0d6d6b5bef3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.746s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:47 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Instance destroyed successfully.
Jul 25 16:54:47 user nova-compute[70659]: DEBUG nova.objects.instance [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lazy-loading 'resources' on Instance uuid 1e549abb-40d8-42d6-ae8f-508d5c13be89 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1311577862',display_name='tempest-ServersNegativeTestJSON-server-1311577862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1311577862',id=18,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c2a00920ce74688937a25cb3db3dd07',ramdisk_id='',reservation_id='r-f6s1wotu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1085604250',owner_user_name='tempest-ServersNegativeTestJSON-1085604250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:53:04Z,user_data=None,user_id='8c06f1babb164e4e9ae334ad5c81ab65',uuid=1e549abb-40d8-42d6-ae8f-508d5c13be89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converting VIF {"id": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "address": "fa:16:3e:e1:9e:fa", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1325bd-4f", "ovs_interfaceid": "1e1325bd-4f52-48a9-a4b6-613aa7c519f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e1325bd-4f52-48a9-a4b6-613aa7c519f5,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1325bd-4f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG os_vif [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e1325bd-4f52-48a9-a4b6-613aa7c519f5,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1325bd-4f') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e1325bd-4f, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:54:47 user nova-compute[70659]: INFO os_vif [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:9e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1e1325bd-4f52-48a9-a4b6-613aa7c519f5,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1325bd-4f')
Jul 25 16:54:47 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Deleting instance files /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89_del
Jul 25 16:54:47 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Deletion of /opt/stack/data/nova/instances/1e549abb-40d8-42d6-ae8f-508d5c13be89_del complete
Jul 25 16:54:48 user nova-compute[70659]: INFO nova.compute.manager [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 25 16:54:48 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:48 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Took 0.60 seconds to deallocate network for instance.
Jul 25 16:54:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-2241ad1a-5665-4bf5-8f7e-f05c47a359b3 req-bad1ef9d-0b6d-4b7e-bf68-284e05c22596 service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received event network-vif-deleted-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received event network-vif-plugged-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] Acquiring lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] No waiting events found dispatching network-vif-plugged-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:49 user nova-compute[70659]: WARNING nova.compute.manager [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received unexpected event network-vif-plugged-1041c77a-2c7a-4b34-86ae-a433671fd870 for instance with vm_state building and task_state spawning.
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received event network-vif-unplugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] Acquiring lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] No waiting events found dispatching network-vif-unplugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:49 user nova-compute[70659]: WARNING nova.compute.manager [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received unexpected event network-vif-unplugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 for instance with vm_state deleted and task_state None.
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received event network-vif-plugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] Acquiring lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] No waiting events found dispatching network-vif-plugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:54:49 user nova-compute[70659]: WARNING nova.compute.manager [req-8d997790-6649-4faf-a96c-3a51592c184d req-40b0e46c-8ab3-4eb9-810f-1558fffc5a8a service nova] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Received unexpected event network-vif-plugged-1e1325bd-4f52-48a9-a4b6-613aa7c519f5 for instance with vm_state deleted and task_state None.
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304089.2228508, fc8e1bf8-976e-4c55-ad33-798cf40234e5 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] VM Resumed (Lifecycle Event)
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:54:49 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Instance spawned successfully.
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304089.2243848, fc8e1bf8-976e-4c55-ad33-798cf40234e5 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] VM Started (Lifecycle Event)
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:49 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Deleted allocations for instance 1e549abb-40d8-42d6-ae8f-508d5c13be89
Jul 25 16:54:49 user nova-compute[70659]: INFO nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Took 6.20 seconds to spawn the instance on the hypervisor.
Jul 25 16:54:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:49 user nova-compute[70659]: INFO nova.compute.manager [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Took 7.17 seconds to build instance.
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-44654eed-b1d2-46b5-bbb2-6b59eeba50c2 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "1e549abb-40d8-42d6-ae8f-508d5c13be89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.499s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8430f2b2-775e-4b53-a80a-02d8c1e88e0b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.268s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:54:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:54:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:52 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:52 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:54:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7193MB free_disk=25.41287612915039GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 743875b3-2013-4162-9940-f1f59ca6c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f6fba6f6-ff72-43c2-b824-f262bf430eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f201428e-c462-4cf2-881c-6712801f2e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 6abb7439-ca84-4a8e-b444-d1a24fe07fde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 51c336bc-e646-4429-809d-354ae03bd8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc8e1bf8-976e-4c55-ad33-798cf40234e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304078.7424617, e9edc2a1-bdba-491c-820d-7a805e268bfb => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:53 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] VM Stopped (Lifecycle Event)
Jul 25 16:54:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2346d7a7-9ee8-4e42-a8e3-616cff4315ab None None] [instance: e9edc2a1-bdba-491c-820d-7a805e268bfb] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:54:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:54:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:54:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:54:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:54:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:54 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:54:54 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:54:55 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updating instance_info_cache with network_info: [{"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-c2800889-2d2e-4660-8bc9-f1f1782587d3" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:54:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:54:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:54:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:54:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:54:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:54:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-d41eed5f-9b27-4fc5-ac10-559ddd8ac8e4 req-7bfe46e8-5abd-4e03-bd14-28f11d2d9784 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received event network-changed-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:54:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-d41eed5f-9b27-4fc5-ac10-559ddd8ac8e4 req-7bfe46e8-5abd-4e03-bd14-28f11d2d9784 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Refreshing instance network info cache due to event network-changed-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:54:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d41eed5f-9b27-4fc5-ac10-559ddd8ac8e4 req-7bfe46e8-5abd-4e03-bd14-28f11d2d9784 service nova] Acquiring lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:54:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d41eed5f-9b27-4fc5-ac10-559ddd8ac8e4 req-7bfe46e8-5abd-4e03-bd14-28f11d2d9784 service nova] Acquired lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:54:57 user nova-compute[70659]: DEBUG nova.network.neutron [req-d41eed5f-9b27-4fc5-ac10-559ddd8ac8e4 req-7bfe46e8-5abd-4e03-bd14-28f11d2d9784 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Refreshing network info cache for port 7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:54:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:54:58 user nova-compute[70659]: DEBUG nova.network.neutron [req-d41eed5f-9b27-4fc5-ac10-559ddd8ac8e4 req-7bfe46e8-5abd-4e03-bd14-28f11d2d9784 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updated VIF entry in instance network info cache for port 7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:54:58 user nova-compute[70659]: DEBUG nova.network.neutron [req-d41eed5f-9b27-4fc5-ac10-559ddd8ac8e4 req-7bfe46e8-5abd-4e03-bd14-28f11d2d9784 service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updating instance_info_cache with network_info: [{"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:54:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d41eed5f-9b27-4fc5-ac10-559ddd8ac8e4 req-7bfe46e8-5abd-4e03-bd14-28f11d2d9784 service nova] Releasing lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:54:59 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304084.6321092, 5192b767-96f0-4789-ac74-0d6d6b5bef3e => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:54:59 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] VM Stopped (Lifecycle Event)
Jul 25 16:54:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-a484649e-3064-4b06-a16d-af4ce85a90c3 None None] [instance: 5192b767-96f0-4789-ac74-0d6d6b5bef3e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:01 user nova-compute[70659]: INFO nova.compute.manager [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attaching volume 96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 to /dev/vdb
Jul 25 16:55:01 user nova-compute[70659]: DEBUG os_brick.utils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d41828-67ba-4095-bf58-9c42ccfb0e54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[20291e71-eb96-46c7-81d1-a22d588164de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c989b5c0-c8f7-41b8-b818-92154efa6114]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[01de6cec-e047-4717-b668-942a7b3bc4c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:55:01 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:55:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca71a32-1e7c-496d-9c68-5236c4e28f8f]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG os_brick.utils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updating existing volume attachment record: 0da2dca2-d3c6-4b3e-a75b-1f46e9646b47 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:55:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:02 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304087.934076, 1e549abb-40d8-42d6-ae8f-508d5c13be89 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:55:02 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] VM Stopped (Lifecycle Event)
Jul 25 16:55:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d304a2bf-55a0-44b7-b6ea-cbba28a26053 None None] [instance: 1e549abb-40d8-42d6-ae8f-508d5c13be89] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:55:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPYBihDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:55:07 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:55:07 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:55:07 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe39939c-7cb1-4d74-9845-6275ea9576e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:55:07 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daec0d8-4fc3-4178-be88-c908899985a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4] added
Jul 25 16:55:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[216b69e7-5088-4326-a9d6-7de97a95228a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e91c3-2320-476d-a931-229f6a52b9b9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPYBihDI {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPYBihDI" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6229c21c-cbc0-41af-8814-271bfe1a4b5a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPYBihDI'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9dc74d-93c6-4ad7-a676-a2412c93d0a6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5eab22-5fc1-4315-a147-e4b3c7bb8efe]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:55:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:55:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c5e98a-bf21-45ac-b56c-f30566058627]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4, portal: 172.16.0.220,3260]
Jul 25 16:55:08 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4, portal: 172.16.0.220,3260] successful.
Jul 25 16:55:08 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f94c45-da99-40a8-ad07-0bdae942ca42]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7995cdff-739c-49a6-958f-e6b961738dc1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:55:08 user nova-compute[70659]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 (non-flash)
Jul 25 16:55:08 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:55:08 user nova-compute[70659]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 (non-flash)
Jul 25 16:55:08 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1348b3fe-905f-4203-83be-2e47a3c069af]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:08 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPYBihDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26238386565383439', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238386565383439', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:55:09 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:55:09 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:55:09 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:55:09 user nova-compute[70659]:   <serial>96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4</serial>
Jul 25 16:55:09 user nova-compute[70659]: </disk>
Jul 25 16:55:09 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No VIF found with MAC fa:16:3e:56:91:c8, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:55:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ed8a5a6c-3741-48ba-9dd1-6854bc8b44f2 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.325s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-a9f78a76-fb02-4e6f-a118-c6d8e3715264 req-e7f1a498-010e-4a54-b19d-52ec4ac06dea service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-changed-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-a9f78a76-fb02-4e6f-a118-c6d8e3715264 req-e7f1a498-010e-4a54-b19d-52ec4ac06dea service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Refreshing instance network info cache due to event network-changed-f4400904-3e5b-4610-af28-f24e8fa7cf20. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:55:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a9f78a76-fb02-4e6f-a118-c6d8e3715264 req-e7f1a498-010e-4a54-b19d-52ec4ac06dea service nova] Acquiring lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:55:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a9f78a76-fb02-4e6f-a118-c6d8e3715264 req-e7f1a498-010e-4a54-b19d-52ec4ac06dea service nova] Acquired lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:55:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-a9f78a76-fb02-4e6f-a118-c6d8e3715264 req-e7f1a498-010e-4a54-b19d-52ec4ac06dea service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Refreshing network info cache for port f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:55:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-a9f78a76-fb02-4e6f-a118-c6d8e3715264 req-e7f1a498-010e-4a54-b19d-52ec4ac06dea service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updated VIF entry in instance network info cache for port f4400904-3e5b-4610-af28-f24e8fa7cf20. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:55:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-a9f78a76-fb02-4e6f-a118-c6d8e3715264 req-e7f1a498-010e-4a54-b19d-52ec4ac06dea service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updating instance_info_cache with network_info: [{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:55:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a9f78a76-fb02-4e6f-a118-c6d8e3715264 req-e7f1a498-010e-4a54-b19d-52ec4ac06dea service nova] Releasing lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:55:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:25 user nova-compute[70659]: INFO nova.compute.manager [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Shelving
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:25 user nova-compute[70659]: INFO nova.compute.manager [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Detaching volume 96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4
Jul 25 16:55:25 user nova-compute[70659]: INFO nova.virt.block_device [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attempting to driver detach volume 96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 from mountpoint /dev/vdb
Jul 25 16:55:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Attempting to detach device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:55:25 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:55:25 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:55:25 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:55:25 user nova-compute[70659]:   <serial>96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4</serial>
Jul 25 16:55:25 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:55:25 user nova-compute[70659]: </disk>
Jul 25 16:55:25 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:55:25 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully detached device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the persistent domain config.
Jul 25 16:55:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:55:25 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:55:25 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:55:25 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:55:25 user nova-compute[70659]:   <serial>96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4</serial>
Jul 25 16:55:25 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:55:25 user nova-compute[70659]: </disk>
Jul 25 16:55:25 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-26b5d9f4-36fa-499e-b63a-d6a7a730be8c req-167cfcc3-552e-4a62-bf29-c2051ca2d46d service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-unplugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-26b5d9f4-36fa-499e-b63a-d6a7a730be8c req-167cfcc3-552e-4a62-bf29-c2051ca2d46d service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-26b5d9f4-36fa-499e-b63a-d6a7a730be8c req-167cfcc3-552e-4a62-bf29-c2051ca2d46d service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-26b5d9f4-36fa-499e-b63a-d6a7a730be8c req-167cfcc3-552e-4a62-bf29-c2051ca2d46d service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-26b5d9f4-36fa-499e-b63a-d6a7a730be8c req-167cfcc3-552e-4a62-bf29-c2051ca2d46d service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-unplugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:25 user nova-compute[70659]: WARNING nova.compute.manager [req-26b5d9f4-36fa-499e-b63a-d6a7a730be8c req-167cfcc3-552e-4a62-bf29-c2051ca2d46d service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-unplugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state active and task_state shelving.
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304126.1963708, f6fba6f6-ff72-43c2-b824-f262bf430eac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:55:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully detached device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the live domain config.
Jul 25 16:55:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance destroyed successfully.
Jul 25 16:55:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPYBihDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:55:26 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4320f6-dcfa-41c5-aed0-67ba7a83af14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1cc45d-554c-4c0c-8d50-6d70b1a62b92]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:55:26 user nova-compute[70659]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 (non-flash)
Jul 25 16:55:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:55:26 user nova-compute[70659]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 (non-flash)
Jul 25 16:55:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd36d7e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Beginning cold snapshot process
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e92779b-9231-4e41-9e7d-0e07ca30efc8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a67708-9151-483d-831e-4ecb5bdd6991]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd6076b-5bbc-430a-9b2c-08d07a435c87]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9679337-8663-4440-8dc2-2c936ef857c9]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf00d18-5b98-40b3-91ca-a3013b34f368]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk /opt/stack/data/nova/instances/snapshots/tmptg2e5wrn/4bba5537b8834aefa4f56a3499ac57b5 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[da716127-8e46-413e-b921-e83a7ad48bc7]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4, portal: 172.16.0.220,3260]
Jul 25 16:55:26 user nova-compute[70659]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4, portal: 172.16.0.220,3260] successful.
Jul 25 16:55:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96656f46-d4bc-45d9-b7ec-cfd3a05bf3d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[211b9a48-5751-4431-a356-d212bf9c6db8]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== disconnect_volume: return (316ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk /opt/stack/data/nova/instances/snapshots/tmptg2e5wrn/4bba5537b8834aefa4f56a3499ac57b5" returned: 0 in 0.505s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Snapshot extracted, beginning image upload
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a1d03de5-aabe-44b2-b4d4-e7b189ed4503 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.009s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:27 user nova-compute[70659]: WARNING nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state active and task_state shelving_image_uploading.
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:27 user nova-compute[70659]: WARNING nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state active and task_state shelving_image_uploading.
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:27 user nova-compute[70659]: WARNING nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state active and task_state shelving_image_uploading.
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-unplugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-unplugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:27 user nova-compute[70659]: WARNING nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-unplugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state active and task_state shelving_image_uploading.
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:27 user nova-compute[70659]: WARNING nova.compute.manager [req-be752613-8b68-48f8-a1ba-20f3cf7ac53b req-2dfab64b-24ae-4ec6-8200-c4775f817ed1 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state active and task_state shelving_image_uploading.
Jul 25 16:55:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:29 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Snapshot image upload complete
Jul 25 16:55:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:55:29 user nova-compute[70659]: INFO nova.compute.manager [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Shelve offloading
Jul 25 16:55:29 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance destroyed successfully.
Jul 25 16:55:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:55:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:55:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquired lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:55:29 user nova-compute[70659]: DEBUG nova.network.neutron [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG nova.network.neutron [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updating instance_info_cache with network_info: [{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Releasing lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:55:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance destroyed successfully.
Jul 25 16:55:30 user nova-compute[70659]: DEBUG nova.objects.instance [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'resources' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-815855632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-815855632',id=20,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEhfa9iHsO529jZd+ffyn0xgIeD3MkiLeQj4DSuZj0p+9yqHe4kmVenPeuEhWGcZMGBx9M4O28CgevctYuBC1FmZHBEY+z6gI3w9uclc7fmYcY3N0HsTx8SOr76rKzjsA==',key_name='tempest-keypair-584068859',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:53:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-3bjpe9kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member',shelved_at='2023-07-25T16:55:29.535767',shelved_host='user',shelved_image_id='1864bb2d-bc87-475a-aaac-10a9d74abd2b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=f201428e-c462-4cf2-881c-6712801f2e02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG os_vif [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4400904-3e, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-9d2409fd-0fb7-4e8d-b5e5-66328d9f9d25 req-1db0a82a-3a52-4ab5-a4ab-740fa9e6b626 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-changed-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-9d2409fd-0fb7-4e8d-b5e5-66328d9f9d25 req-1db0a82a-3a52-4ab5-a4ab-740fa9e6b626 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Refreshing instance network info cache due to event network-changed-f4400904-3e5b-4610-af28-f24e8fa7cf20. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9d2409fd-0fb7-4e8d-b5e5-66328d9f9d25 req-1db0a82a-3a52-4ab5-a4ab-740fa9e6b626 service nova] Acquiring lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9d2409fd-0fb7-4e8d-b5e5-66328d9f9d25 req-1db0a82a-3a52-4ab5-a4ab-740fa9e6b626 service nova] Acquired lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG nova.network.neutron [req-9d2409fd-0fb7-4e8d-b5e5-66328d9f9d25 req-1db0a82a-3a52-4ab5-a4ab-740fa9e6b626 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Refreshing network info cache for port f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:55:30 user nova-compute[70659]: INFO os_vif [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e')
Jul 25 16:55:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Deleting instance files /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02_del
Jul 25 16:55:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Deletion of /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02_del complete
Jul 25 16:55:30 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Deleted allocations for instance f201428e-c462-4cf2-881c-6712801f2e02
Jul 25 16:55:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:30 user nova-compute[70659]: DEBUG nova.objects.instance [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'numa_topology' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:31 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:55:31 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:55:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37231e72-a6d7-4e2f-9a24-c598a9d80c39 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.068s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:31 user nova-compute[70659]: DEBUG nova.network.neutron [req-9d2409fd-0fb7-4e8d-b5e5-66328d9f9d25 req-1db0a82a-3a52-4ab5-a4ab-740fa9e6b626 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updated VIF entry in instance network info cache for port f4400904-3e5b-4610-af28-f24e8fa7cf20. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:55:31 user nova-compute[70659]: DEBUG nova.network.neutron [req-9d2409fd-0fb7-4e8d-b5e5-66328d9f9d25 req-1db0a82a-3a52-4ab5-a4ab-740fa9e6b626 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updating instance_info_cache with network_info: [{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf4400904-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:55:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9d2409fd-0fb7-4e8d-b5e5-66328d9f9d25 req-1db0a82a-3a52-4ab5-a4ab-740fa9e6b626 service nova] Releasing lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:55:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:40 user nova-compute[70659]: INFO nova.compute.manager [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Terminating instance
Jul 25 16:55:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-70449e1b-dddf-416e-a8e2-319d521d3700 req-1e7f4ca5-ae31-4925-b2a2-73ae413ebe03 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-unplugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70449e1b-dddf-416e-a8e2-319d521d3700 req-1e7f4ca5-ae31-4925-b2a2-73ae413ebe03 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70449e1b-dddf-416e-a8e2-319d521d3700 req-1e7f4ca5-ae31-4925-b2a2-73ae413ebe03 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-70449e1b-dddf-416e-a8e2-319d521d3700 req-1e7f4ca5-ae31-4925-b2a2-73ae413ebe03 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-70449e1b-dddf-416e-a8e2-319d521d3700 req-1e7f4ca5-ae31-4925-b2a2-73ae413ebe03 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-unplugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-70449e1b-dddf-416e-a8e2-319d521d3700 req-1e7f4ca5-ae31-4925-b2a2-73ae413ebe03 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-unplugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304126.20817, f201428e-c462-4cf2-881c-6712801f2e02 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:55:41 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] VM Stopped (Lifecycle Event)
Jul 25 16:55:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9b1c58e5-561f-47a2-b3c4-e85edcd0510a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:55:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Instance destroyed successfully.
Jul 25 16:55:41 user nova-compute[70659]: DEBUG nova.objects.instance [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'resources' on Instance uuid 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252348890',display_name='tempest-AttachVolumeTestJSON-server-1252348890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252348890',id=5,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl7hEIoOzploaaVJzvHH8s9XWd3DqHJQDS4RGFYYAnouMce0kg5Qq6bJLKJ1xPuEcKILYqVCIIw7SRQhcjnOOD1emebVM/xSSTVD/YqNbIqjFDTdfW8AR1dAleT+Ed0Qw==',key_name='tempest-keypair-1208202396',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-dwrzw3y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=9df22b5f-c0e3-4eb5-9054-c593d0660ee5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "3c7f2734-73c4-4648-a080-0ea25238dad8", "address": "fa:16:3e:ea:f3:27", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7f2734-73", "ovs_interfaceid": "3c7f2734-73c4-4648-a080-0ea25238dad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG os_vif [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c7f2734-73, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:55:41 user nova-compute[70659]: INFO os_vif [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:27,bridge_name='br-int',has_traffic_filtering=True,id=3c7f2734-73c4-4648-a080-0ea25238dad8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7f2734-73')
Jul 25 16:55:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Deleting instance files /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5_del
Jul 25 16:55:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Deletion of /opt/stack/data/nova/instances/9df22b5f-c0e3-4eb5-9054-c593d0660ee5_del complete
Jul 25 16:55:41 user nova-compute[70659]: INFO nova.compute.manager [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 25 16:55:41 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:55:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:42 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:55:42 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Took 0.93 seconds to deallocate network for instance.
Jul 25 16:55:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:42 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:55:42 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:55:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:42 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Deleted allocations for instance 9df22b5f-c0e3-4eb5-9054-c593d0660ee5
Jul 25 16:55:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f26c2396-f0bd-4641-a796-f07c2aa1c9eb tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.336s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-f4803e63-b96f-4ea6-872d-bf4f2651ed9a req-ab54326d-e399-48a0-864f-33f82714eae2 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f4803e63-b96f-4ea6-872d-bf4f2651ed9a req-ab54326d-e399-48a0-864f-33f82714eae2 service nova] Acquiring lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f4803e63-b96f-4ea6-872d-bf4f2651ed9a req-ab54326d-e399-48a0-864f-33f82714eae2 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f4803e63-b96f-4ea6-872d-bf4f2651ed9a req-ab54326d-e399-48a0-864f-33f82714eae2 service nova] Lock "9df22b5f-c0e3-4eb5-9054-c593d0660ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-f4803e63-b96f-4ea6-872d-bf4f2651ed9a req-ab54326d-e399-48a0-864f-33f82714eae2 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] No waiting events found dispatching network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:43 user nova-compute[70659]: WARNING nova.compute.manager [req-f4803e63-b96f-4ea6-872d-bf4f2651ed9a req-ab54326d-e399-48a0-864f-33f82714eae2 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received unexpected event network-vif-plugged-3c7f2734-73c4-4648-a080-0ea25238dad8 for instance with vm_state deleted and task_state None.
Jul 25 16:55:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-f4803e63-b96f-4ea6-872d-bf4f2651ed9a req-ab54326d-e399-48a0-864f-33f82714eae2 service nova] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Received event network-vif-deleted-3c7f2734-73c4-4648-a080-0ea25238dad8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:45 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:51 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:55:51 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:55:51 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7350MB free_disk=25.35251235961914GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 743875b3-2013-4162-9940-f1f59ca6c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f6fba6f6-ff72-43c2-b824-f262bf430eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 6abb7439-ca84-4a8e-b444-d1a24fe07fde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 51c336bc-e646-4429-809d-354ae03bd8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc8e1bf8-976e-4c55-ad33-798cf40234e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:55:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:54 user nova-compute[70659]: INFO nova.compute.manager [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Rescuing
Jul 25 16:55:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquired lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updating instance_info_cache with network_info: [{"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Releasing lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:55:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-96c43b75-3402-43f7-9e97-d71a91865722 req-ad914095-2411-4912-ab85-5733c8c00f8f service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-unplugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-96c43b75-3402-43f7-9e97-d71a91865722 req-ad914095-2411-4912-ab85-5733c8c00f8f service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-96c43b75-3402-43f7-9e97-d71a91865722 req-ad914095-2411-4912-ab85-5733c8c00f8f service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-96c43b75-3402-43f7-9e97-d71a91865722 req-ad914095-2411-4912-ab85-5733c8c00f8f service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-96c43b75-3402-43f7-9e97-d71a91865722 req-ad914095-2411-4912-ab85-5733c8c00f8f service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-unplugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:55 user nova-compute[70659]: WARNING nova.compute.manager [req-96c43b75-3402-43f7-9e97-d71a91865722 req-ad914095-2411-4912-ab85-5733c8c00f8f service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-unplugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state active and task_state rescuing.
Jul 25 16:55:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Updating instance_info_cache with network_info: [{"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:55:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] Instance destroyed successfully.
Jul 25 16:55:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Attempting a stable device rescue
Jul 25 16:55:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70659) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Instance directory exists: not creating {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 16:55:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Creating image(s)
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "/opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "/opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "/opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "769ac1b71e050805c9f4925d1b4fd05744857173" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "769ac1b71e050805c9f4925d1b4fd05744857173" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:56 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304141.3942115, 9df22b5f-c0e3-4eb5-9054-c593d0660ee5 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:55:56 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] VM Stopped (Lifecycle Event)
Jul 25 16:55:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ddbb8711-1b66-4f8b-9c34-b194dcdad58c None None] [instance: 9df22b5f-c0e3-4eb5-9054-c593d0660ee5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:55:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173.part --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:56 user nova-compute[70659]: DEBUG nova.virt.images [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] 82466912-b612-43c9-9623-e20a8cd9fd36 was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 16:55:56 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 16:55:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173.part /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173.part /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173.converted" returned: 0 in 0.236s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "769ac1b71e050805c9f4925d1b4fd05744857173" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.447s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "769ac1b71e050805c9f4925d1b4fd05744857173" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "769ac1b71e050805c9f4925d1b4fd05744857173" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-9e3b5f25-0b82-4dce-859f-149620376202 req-37c5345c-eb49-410a-89ff-2724c4ea278c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9e3b5f25-0b82-4dce-859f-149620376202 req-37c5345c-eb49-410a-89ff-2724c4ea278c service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9e3b5f25-0b82-4dce-859f-149620376202 req-37c5345c-eb49-410a-89ff-2724c4ea278c service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9e3b5f25-0b82-4dce-859f-149620376202 req-37c5345c-eb49-410a-89ff-2724c4ea278c service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-9e3b5f25-0b82-4dce-859f-149620376202 req-37c5345c-eb49-410a-89ff-2724c4ea278c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:57 user nova-compute[70659]: WARNING nova.compute.manager [req-9e3b5f25-0b82-4dce-859f-149620376202 req-37c5345c-eb49-410a-89ff-2724c4ea278c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state active and task_state rescuing.
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173 --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173,backing_fmt=raw /opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.rescue {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173,backing_fmt=raw /opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.rescue" returned: 0 in 0.051s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "769ac1b71e050805c9f4925d1b4fd05744857173" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'migration_context' on Instance uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Start _get_guest_xml network_info=[{"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "vif_mac": "fa:16:3e:27:fd:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '82466912-b612-43c9-9623-e20a8cd9fd36', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '58190ca5-465b-42fa-950c-848b3c284ccd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgyGcDmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '73980900-2093-4338-8460-d91df2e2709d', 'attached_at': '', 'detached_at': '', 'volume_id': '929c72cf-3ffe-49a9-b089-888195ea9970', 'serial': '929c72cf-3ffe-49a9-b089-888195ea9970'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'resources' on Instance uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'numa_topology' on Instance uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:57 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:55:57 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgyGcDmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:55:57 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:55:57 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:55:57 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eefba8-1ac5-4122-ba4f-e8c8e4680a75]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PgyGcDmz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 25 16:55:57 user nova-compute[70659]: node.name = iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970
Jul 25 16:55:57 user nova-compute[70659]: node.tpgt = -1
Jul 25 16:55:57 user nova-compute[70659]: node.startup = automatic
Jul 25 16:55:57 user nova-compute[70659]: node.leading_login = No
Jul 25 16:55:57 user nova-compute[70659]: iface.iscsi_ifacename = default
Jul 25 16:55:57 user nova-compute[70659]: iface.net_ifacename = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.ipaddress = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.prefix_len = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.hwaddress = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.transport_name = tcp
Jul 25 16:55:57 user nova-compute[70659]: iface.initiatorname = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.state = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.vlan_id = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.vlan_priority = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.vlan_state = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.iface_num = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.mtu = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.port = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.bootproto = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.subnet_mask = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.gateway = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.dhcp_alt_client_id_state = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.dhcp_alt_client_id = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.dhcp_dns = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.dhcp_learn_iqn = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.dhcp_req_vendor_id_state = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.dhcp_vendor_id_state = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.dhcp_vendor_id = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.dhcp_slp_da = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.fragmentation = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.gratuitous_arp = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.incoming_forwarding = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.tos_state = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.tos = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.ttl = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.delayed_ack = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.tcp_nagle = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.tcp_wsf_state = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.tcp_wsf = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.tcp_timer_scale = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.tcp_timestamp = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.redirect = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.def_task_mgmt_timeout = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.header_digest = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.data_digest = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.immediate_data = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.initial_r2t = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.data_seq_inorder = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.data_pdu_inorder = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.erl = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.max_receive_data_len = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.first_burst_len = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.max_outstanding_r2t = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.max_burst_len = 0
Jul 25 16:55:57 user nova-compute[70659]: iface.chap_auth = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.bidi_chap = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.strict_login_compliance = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.discovery_auth = <empty>
Jul 25 16:55:57 user nova-compute[70659]: iface.discovery_logout = <empty>
Jul 25 16:55:57 user nova-compute[70659]: node.discovery_address = <empty>
Jul 25 16:55:57 user nova-compute[70659]: node.discovery_port = 0
Jul 25 16:55:57 user nova-compute[70659]: node.discovery_type = static
Jul 25 16:55:57 user nova-compute[70659]: node.session.initial_cmdsn = 0
Jul 25 16:55:57 user nova-compute[70659]: node.session.initial_login_retry_max = 8
Jul 25 16:55:57 user nova-compute[70659]: node.session.xmit_thread_priority = -20
Jul 25 16:55:57 user nova-compute[70659]: node.session.cmds_max = 128
Jul 25 16:55:57 user nova-compute[70659]: node.session.queue_depth = 32
Jul 25 16:55:57 user nova-compute[70659]: node.session.nr_sessions = 1
Jul 25 16:55:57 user nova-compute[70659]: node.session.auth.authmethod = CHAP
Jul 25 16:55:57 user nova-compute[70659]: node.session.auth.username = PgyGcDmz
Jul 25 16:55:57 user nova-compute[70659]: node.session.auth.password = ***
Jul 25 16:55:57 user nova-compute[70659]: node.session.auth.username_in = <empty>
Jul 25 16:55:57 user nova-compute[70659]: node.session.auth.password_in = <empty>
Jul 25 16:55:57 user nova-compute[70659]: node.session.auth.chap_algs = MD5
Jul 25 16:55:57 user nova-compute[70659]: node.session.timeo.replacement_timeout = 120
Jul 25 16:55:57 user nova-compute[70659]: node.session.err_timeo.abort_timeout = 15
Jul 25 16:55:57 user nova-compute[70659]: node.session.err_timeo.lu_reset_timeout = 30
Jul 25 16:55:57 user nova-compute[70659]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 25 16:55:57 user nova-compute[70659]: node.session.err_timeo.host_reset_timeout = 60
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.FastAbort = Yes
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.InitialR2T = No
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.ImmediateData = Yes
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.FirstBurstLength = 262144
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.MaxBurstLength = 16776192
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.DefaultTime2Retain = 0
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.DefaultTime2Wait = 2
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.MaxConnections = 1
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 25 16:55:57 user nova-compute[70659]: node.session.iscsi.ERL = 0
Jul 25 16:55:57 user nova-compute[70659]: node.session.scan = manual
Jul 25 16:55:57 user nova-compute[70659]: node.session.reopen_max = 0
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].address = 172.16.0.220
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].port = 3260
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].startup = manual
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].tcp.window_size = 524288
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].tcp.type_of_service = 0
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].timeo.logout_timeout = 15
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].timeo.login_timeout = 15
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].timeo.auth_timeout = 45
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].timeo.noop_out_interval = 5
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].timeo.noop_out_timeout = 5
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].iscsi.HeaderDigest = None
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].iscsi.DataDigest = None
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].iscsi.IFMarker = No
Jul 25 16:55:57 user nova-compute[70659]: node.conn[0].iscsi.OFMarker = No
Jul 25 16:55:57 user nova-compute[70659]: # END RECORD
Jul 25 16:55:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[11689257-2d1e-489c-a375-1bf6f3943c70]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd886cc4-bd21-474c-93e3-3d84b8dc0eb6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PgyGcDmz {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PgyGcDmz" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[918c96e0-1a79-4d51-aa00-b796d8631419]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PgyGcDmz'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0277a0c-ab2c-4d5d-a374-848eac16ccdb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[05380c74-7f8c-4f87-b8ae-06def602fd0e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:55:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:55:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] HCTL ('34', '0', '0', 0) found on session 26 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8869599-0e59-423a-8aa2-8053d2539863]: (4, ('0 0 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching for a device in session 26 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgyGcDmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '23062363261376230', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062363261376230', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1788636919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1788636919',id=21,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:54:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-5jvc40sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:21Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=73980900-2093-4338-8460-d91df2e2709d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "vif_mac": "fa:16:3e:27:fd:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "vif_mac": "fa:16:3e:27:fd:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:fd:9a,bridge_name='br-int',has_traffic_filtering=True,id=46fdf795-f2fd-419b-96b3-9c45c3fe9a44,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46fdf795-f2') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'pci_devices' on Instance uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:55:57 user nova-compute[70659]:   <uuid>73980900-2093-4338-8460-d91df2e2709d</uuid>
Jul 25 16:55:57 user nova-compute[70659]:   <name>instance-00000015</name>
Jul 25 16:55:57 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:55:57 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:55:57 user nova-compute[70659]:   <metadata>
Jul 25 16:55:57 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:55:57 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:55:57 user nova-compute[70659]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1788636919</nova:name>
Jul 25 16:55:57 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:55:57</nova:creationTime>
Jul 25 16:55:57 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:55:57 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:55:57 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:55:57 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:55:57 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:55:57 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:55:57 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:55:57 user nova-compute[70659]:       <nova:owner>
Jul 25 16:55:57 user nova-compute[70659]:         <nova:user uuid="913d51a0ff3746c5bdadd59fdf14e787">tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member</nova:user>
Jul 25 16:55:57 user nova-compute[70659]:         <nova:project uuid="1ef5ee6f08d04772994840a8973da621">tempest-ServerBootFromVolumeStableRescueTest-191665891</nova:project>
Jul 25 16:55:57 user nova-compute[70659]:       </nova:owner>
Jul 25 16:55:57 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:55:57 user nova-compute[70659]:       <nova:ports>
Jul 25 16:55:57 user nova-compute[70659]:         <nova:port uuid="46fdf795-f2fd-419b-96b3-9c45c3fe9a44">
Jul 25 16:55:57 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 16:55:57 user nova-compute[70659]:         </nova:port>
Jul 25 16:55:57 user nova-compute[70659]:       </nova:ports>
Jul 25 16:55:57 user nova-compute[70659]:     </nova:instance>
Jul 25 16:55:57 user nova-compute[70659]:   </metadata>
Jul 25 16:55:57 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:55:57 user nova-compute[70659]:     <system>
Jul 25 16:55:57 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:55:57 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:55:57 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:55:57 user nova-compute[70659]:       <entry name="serial">73980900-2093-4338-8460-d91df2e2709d</entry>
Jul 25 16:55:57 user nova-compute[70659]:       <entry name="uuid">73980900-2093-4338-8460-d91df2e2709d</entry>
Jul 25 16:55:57 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:55:57 user nova-compute[70659]:     </system>
Jul 25 16:55:57 user nova-compute[70659]:   </sysinfo>
Jul 25 16:55:57 user nova-compute[70659]:   <os>
Jul 25 16:55:57 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:55:57 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:55:57 user nova-compute[70659]:   </os>
Jul 25 16:55:57 user nova-compute[70659]:   <features>
Jul 25 16:55:57 user nova-compute[70659]:     <acpi/>
Jul 25 16:55:57 user nova-compute[70659]:     <apic/>
Jul 25 16:55:57 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:55:57 user nova-compute[70659]:   </features>
Jul 25 16:55:57 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:55:57 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:55:57 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:55:57 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:55:57 user nova-compute[70659]:   </clock>
Jul 25 16:55:57 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:55:57 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:55:57 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:55:57 user nova-compute[70659]:   </cpu>
Jul 25 16:55:57 user nova-compute[70659]:   <devices>
Jul 25 16:55:57 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 16:55:57 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:55:57 user nova-compute[70659]:       <source dev="/dev/sdc"/>
Jul 25 16:55:57 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:55:57 user nova-compute[70659]:       <serial>929c72cf-3ffe-49a9-b089-888195ea9970</serial>
Jul 25 16:55:57 user nova-compute[70659]:     </disk>
Jul 25 16:55:57 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:55:57 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:55:57 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.rescue"/>
Jul 25 16:55:57 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 16:55:57 user nova-compute[70659]:       <boot order="1"/>
Jul 25 16:55:57 user nova-compute[70659]:     </disk>
Jul 25 16:55:57 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:55:57 user nova-compute[70659]:       <mac address="fa:16:3e:27:fd:9a"/>
Jul 25 16:55:57 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:55:57 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:55:57 user nova-compute[70659]:       <target dev="tap46fdf795-f2"/>
Jul 25 16:55:57 user nova-compute[70659]:     </interface>
Jul 25 16:55:57 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:55:57 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/console.log" append="off"/>
Jul 25 16:55:57 user nova-compute[70659]:     </serial>
Jul 25 16:55:57 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:55:57 user nova-compute[70659]:     <video>
Jul 25 16:55:57 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:55:57 user nova-compute[70659]:     </video>
Jul 25 16:55:57 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:55:57 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:55:57 user nova-compute[70659]:     </rng>
Jul 25 16:55:57 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:55:57 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:55:57 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:55:57 user nova-compute[70659]:     </memballoon>
Jul 25 16:55:57 user nova-compute[70659]:   </devices>
Jul 25 16:55:57 user nova-compute[70659]: </domain>
Jul 25 16:55:57 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:55:57 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] Instance destroyed successfully.
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No VIF found with MAC fa:16:3e:27:fd:9a, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:55:57 user nova-compute[70659]: INFO nova.compute.claims [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Claim successful on node user
Jul 25 16:55:58 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:55:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:55:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG nova.policy [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaa312fa9268469da0d93402717c0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '299fab0987cc403994552275bf4a8e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:55:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Creating image(s)
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "/opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "/opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk 1073741824" returned: 0 in 0.052s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Cannot resize image /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'migration_context' on Instance uuid f8fe25a3-fe0b-40a6-ad75-cdef0924154d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Ensure instance console log exists: /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Successfully created port: 5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-aff7d6fe-e902-42b7-88f7-5ea63826872f req-6fc69d94-a52b-4495-9b14-6ccb1b333521 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-aff7d6fe-e902-42b7-88f7-5ea63826872f req-6fc69d94-a52b-4495-9b14-6ccb1b333521 service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-aff7d6fe-e902-42b7-88f7-5ea63826872f req-6fc69d94-a52b-4495-9b14-6ccb1b333521 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-aff7d6fe-e902-42b7-88f7-5ea63826872f req-6fc69d94-a52b-4495-9b14-6ccb1b333521 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-aff7d6fe-e902-42b7-88f7-5ea63826872f req-6fc69d94-a52b-4495-9b14-6ccb1b333521 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:55:59 user nova-compute[70659]: WARNING nova.compute.manager [req-aff7d6fe-e902-42b7-88f7-5ea63826872f req-6fc69d94-a52b-4495-9b14-6ccb1b333521 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state active and task_state rescuing.
Jul 25 16:55:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:55:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Successfully updated port: 5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "refresh_cache-f8fe25a3-fe0b-40a6-ad75-cdef0924154d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquired lock "refresh_cache-f8fe25a3-fe0b-40a6-ad75-cdef0924154d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-9105f562-bb9b-4924-88a0-4bdf057c279a req-b72e5495-762e-46e0-8121-5249620ae11e service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received event network-changed-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-9105f562-bb9b-4924-88a0-4bdf057c279a req-b72e5495-762e-46e0-8121-5249620ae11e service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Refreshing instance network info cache due to event network-changed-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9105f562-bb9b-4924-88a0-4bdf057c279a req-b72e5495-762e-46e0-8121-5249620ae11e service nova] Acquiring lock "refresh_cache-f8fe25a3-fe0b-40a6-ad75-cdef0924154d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Updating instance_info_cache with network_info: [{"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Releasing lock "refresh_cache-f8fe25a3-fe0b-40a6-ad75-cdef0924154d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Instance network_info: |[{"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9105f562-bb9b-4924-88a0-4bdf057c279a req-b72e5495-762e-46e0-8121-5249620ae11e service nova] Acquired lock "refresh_cache-f8fe25a3-fe0b-40a6-ad75-cdef0924154d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-9105f562-bb9b-4924-88a0-4bdf057c279a req-b72e5495-762e-46e0-8121-5249620ae11e service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Refreshing network info cache for port 5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Start _get_guest_xml network_info=[{"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:56:00 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:00 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1458644841',display_name='tempest-VolumesSnapshotTestJSON-instance-1458644841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1458644841',id=25,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8wpz0BnsnWe4od+gCfkMb/Ba5t4TsAQM3Upq8zLDBarEfAeYwPdSN4SPpuKdUn+OU9DUYKzDypA5psTpEwQ1hvFKEejmXQg/MYpNtlbdg4Caqh2m4CFqSW/5Tc0FN6w==',key_name='tempest-keypair-178804725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='299fab0987cc403994552275bf4a8e6e',ramdisk_id='',reservation_id='r-936waw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-772652394',owner_user_name='tempest-VolumesSnapshotTestJSON-772652394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaa312fa9268469da0d93402717c0798',uuid=f8fe25a3-fe0b-40a6-ad75-cdef0924154d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converting VIF {"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:f1,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ed02-82') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'pci_devices' on Instance uuid f8fe25a3-fe0b-40a6-ad75-cdef0924154d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:56:00 user nova-compute[70659]:   <uuid>f8fe25a3-fe0b-40a6-ad75-cdef0924154d</uuid>
Jul 25 16:56:00 user nova-compute[70659]:   <name>instance-00000019</name>
Jul 25 16:56:00 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:56:00 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:56:00 user nova-compute[70659]:   <metadata>
Jul 25 16:56:00 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:56:00 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:56:00 user nova-compute[70659]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1458644841</nova:name>
Jul 25 16:56:00 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:56:00</nova:creationTime>
Jul 25 16:56:00 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:56:00 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:56:00 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:56:00 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:56:00 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:56:00 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:56:00 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:56:00 user nova-compute[70659]:       <nova:owner>
Jul 25 16:56:00 user nova-compute[70659]:         <nova:user uuid="aaa312fa9268469da0d93402717c0798">tempest-VolumesSnapshotTestJSON-772652394-project-member</nova:user>
Jul 25 16:56:00 user nova-compute[70659]:         <nova:project uuid="299fab0987cc403994552275bf4a8e6e">tempest-VolumesSnapshotTestJSON-772652394</nova:project>
Jul 25 16:56:00 user nova-compute[70659]:       </nova:owner>
Jul 25 16:56:00 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:56:00 user nova-compute[70659]:       <nova:ports>
Jul 25 16:56:00 user nova-compute[70659]:         <nova:port uuid="5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3">
Jul 25 16:56:00 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 16:56:00 user nova-compute[70659]:         </nova:port>
Jul 25 16:56:00 user nova-compute[70659]:       </nova:ports>
Jul 25 16:56:00 user nova-compute[70659]:     </nova:instance>
Jul 25 16:56:00 user nova-compute[70659]:   </metadata>
Jul 25 16:56:00 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:56:00 user nova-compute[70659]:     <system>
Jul 25 16:56:00 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:56:00 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:56:00 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:56:00 user nova-compute[70659]:       <entry name="serial">f8fe25a3-fe0b-40a6-ad75-cdef0924154d</entry>
Jul 25 16:56:00 user nova-compute[70659]:       <entry name="uuid">f8fe25a3-fe0b-40a6-ad75-cdef0924154d</entry>
Jul 25 16:56:00 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:56:00 user nova-compute[70659]:     </system>
Jul 25 16:56:00 user nova-compute[70659]:   </sysinfo>
Jul 25 16:56:00 user nova-compute[70659]:   <os>
Jul 25 16:56:00 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:56:00 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:56:00 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:56:00 user nova-compute[70659]:   </os>
Jul 25 16:56:00 user nova-compute[70659]:   <features>
Jul 25 16:56:00 user nova-compute[70659]:     <acpi/>
Jul 25 16:56:00 user nova-compute[70659]:     <apic/>
Jul 25 16:56:00 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:56:00 user nova-compute[70659]:   </features>
Jul 25 16:56:00 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:56:00 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:56:00 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:56:00 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:56:00 user nova-compute[70659]:   </clock>
Jul 25 16:56:00 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:56:00 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:56:00 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:56:00 user nova-compute[70659]:   </cpu>
Jul 25 16:56:00 user nova-compute[70659]:   <devices>
Jul 25 16:56:00 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:56:00 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:56:00 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk"/>
Jul 25 16:56:00 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:56:00 user nova-compute[70659]:     </disk>
Jul 25 16:56:00 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:56:00 user nova-compute[70659]:       <mac address="fa:16:3e:cc:e0:f1"/>
Jul 25 16:56:00 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:56:00 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:56:00 user nova-compute[70659]:       <target dev="tap5ba5ed02-82"/>
Jul 25 16:56:00 user nova-compute[70659]:     </interface>
Jul 25 16:56:00 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:56:00 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/console.log" append="off"/>
Jul 25 16:56:00 user nova-compute[70659]:     </serial>
Jul 25 16:56:00 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:56:00 user nova-compute[70659]:     <video>
Jul 25 16:56:00 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:56:00 user nova-compute[70659]:     </video>
Jul 25 16:56:00 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:56:00 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:56:00 user nova-compute[70659]:     </rng>
Jul 25 16:56:00 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:56:00 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:56:00 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:56:00 user nova-compute[70659]:     </memballoon>
Jul 25 16:56:00 user nova-compute[70659]:   </devices>
Jul 25 16:56:00 user nova-compute[70659]: </domain>
Jul 25 16:56:00 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1458644841',display_name='tempest-VolumesSnapshotTestJSON-instance-1458644841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1458644841',id=25,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8wpz0BnsnWe4od+gCfkMb/Ba5t4TsAQM3Upq8zLDBarEfAeYwPdSN4SPpuKdUn+OU9DUYKzDypA5psTpEwQ1hvFKEejmXQg/MYpNtlbdg4Caqh2m4CFqSW/5Tc0FN6w==',key_name='tempest-keypair-178804725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='299fab0987cc403994552275bf4a8e6e',ramdisk_id='',reservation_id='r-936waw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-772652394',owner_user_name='tempest-VolumesSnapshotTestJSON-772652394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaa312fa9268469da0d93402717c0798',uuid=f8fe25a3-fe0b-40a6-ad75-cdef0924154d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converting VIF {"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:f1,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ed02-82') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG os_vif [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:f1,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ed02-82') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ba5ed02-82, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ba5ed02-82, col_values=(('external_ids', {'iface-id': '5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:e0:f1', 'vm-uuid': 'f8fe25a3-fe0b-40a6-ad75-cdef0924154d'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:00 user nova-compute[70659]: INFO os_vif [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:f1,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ed02-82')
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No VIF found with MAC fa:16:3e:cc:e0:f1, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-9105f562-bb9b-4924-88a0-4bdf057c279a req-b72e5495-762e-46e0-8121-5249620ae11e service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Updated VIF entry in instance network info cache for port 5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-9105f562-bb9b-4924-88a0-4bdf057c279a req-b72e5495-762e-46e0-8121-5249620ae11e service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Updating instance_info_cache with network_info: [{"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9105f562-bb9b-4924-88a0-4bdf057c279a req-b72e5495-762e-46e0-8121-5249620ae11e service nova] Releasing lock "refresh_cache-f8fe25a3-fe0b-40a6-ad75-cdef0924154d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for 73980900-2093-4338-8460-d91df2e2709d due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304161.2820442, 73980900-2093-4338-8460-d91df2e2709d => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:01 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] VM Resumed (Lifecycle Event)
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4ad2b25f-4c72-4c1f-a099-21b5dc72f434 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:01 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304161.2848, 73980900-2093-4338-8460-d91df2e2709d => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:01 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] VM Started (Lifecycle Event)
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:01 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-9e009a0b-bb04-4218-9141-953f8311b8ec req-77bda033-fc73-4399-8b42-ccf9bfd8fd5c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9e009a0b-bb04-4218-9141-953f8311b8ec req-77bda033-fc73-4399-8b42-ccf9bfd8fd5c service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9e009a0b-bb04-4218-9141-953f8311b8ec req-77bda033-fc73-4399-8b42-ccf9bfd8fd5c service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9e009a0b-bb04-4218-9141-953f8311b8ec req-77bda033-fc73-4399-8b42-ccf9bfd8fd5c service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-9e009a0b-bb04-4218-9141-953f8311b8ec req-77bda033-fc73-4399-8b42-ccf9bfd8fd5c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:01 user nova-compute[70659]: WARNING nova.compute.manager [req-9e009a0b-bb04-4218-9141-953f8311b8ec req-77bda033-fc73-4399-8b42-ccf9bfd8fd5c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state rescued and task_state None.
Jul 25 16:56:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-d8a5eb4a-c259-43de-a619-6df5abddb134 req-f9dd5fb8-a6c9-420d-913a-c85de1e3370f service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received event network-vif-plugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d8a5eb4a-c259-43de-a619-6df5abddb134 req-f9dd5fb8-a6c9-420d-913a-c85de1e3370f service nova] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d8a5eb4a-c259-43de-a619-6df5abddb134 req-f9dd5fb8-a6c9-420d-913a-c85de1e3370f service nova] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d8a5eb4a-c259-43de-a619-6df5abddb134 req-f9dd5fb8-a6c9-420d-913a-c85de1e3370f service nova] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-d8a5eb4a-c259-43de-a619-6df5abddb134 req-f9dd5fb8-a6c9-420d-913a-c85de1e3370f service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] No waiting events found dispatching network-vif-plugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:02 user nova-compute[70659]: WARNING nova.compute.manager [req-d8a5eb4a-c259-43de-a619-6df5abddb134 req-f9dd5fb8-a6c9-420d-913a-c85de1e3370f service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received unexpected event network-vif-plugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 for instance with vm_state building and task_state spawning.
Jul 25 16:56:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304164.1958308, f8fe25a3-fe0b-40a6-ad75-cdef0924154d => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:04 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] VM Resumed (Lifecycle Event)
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:56:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Instance spawned successfully.
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:04 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304164.1979887, f8fe25a3-fe0b-40a6-ad75-cdef0924154d => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:04 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] VM Started (Lifecycle Event)
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:04 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-0158d49e-a39a-41ca-908e-8101da1617b8 req-081845be-a432-4034-aa35-2f89b1206605 service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received event network-vif-plugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0158d49e-a39a-41ca-908e-8101da1617b8 req-081845be-a432-4034-aa35-2f89b1206605 service nova] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0158d49e-a39a-41ca-908e-8101da1617b8 req-081845be-a432-4034-aa35-2f89b1206605 service nova] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0158d49e-a39a-41ca-908e-8101da1617b8 req-081845be-a432-4034-aa35-2f89b1206605 service nova] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-0158d49e-a39a-41ca-908e-8101da1617b8 req-081845be-a432-4034-aa35-2f89b1206605 service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] No waiting events found dispatching network-vif-plugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:04 user nova-compute[70659]: WARNING nova.compute.manager [req-0158d49e-a39a-41ca-908e-8101da1617b8 req-081845be-a432-4034-aa35-2f89b1206605 service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received unexpected event network-vif-plugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 for instance with vm_state building and task_state spawning.
Jul 25 16:56:04 user nova-compute[70659]: INFO nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Took 5.83 seconds to spawn the instance on the hypervisor.
Jul 25 16:56:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:04 user nova-compute[70659]: INFO nova.compute.manager [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Took 6.60 seconds to build instance.
Jul 25 16:56:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b835c3cb-bc53-478d-a73c-6d80a04f4af5 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.695s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:09 user nova-compute[70659]: INFO nova.compute.manager [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Terminating instance
Jul 25 16:56:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-2c5d4e71-df4e-4b8d-b834-b8557d8d8f7a req-b137b9d2-09bb-4fef-9817-269f130f245d service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received event network-vif-unplugged-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2c5d4e71-df4e-4b8d-b834-b8557d8d8f7a req-b137b9d2-09bb-4fef-9817-269f130f245d service nova] Acquiring lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2c5d4e71-df4e-4b8d-b834-b8557d8d8f7a req-b137b9d2-09bb-4fef-9817-269f130f245d service nova] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2c5d4e71-df4e-4b8d-b834-b8557d8d8f7a req-b137b9d2-09bb-4fef-9817-269f130f245d service nova] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-2c5d4e71-df4e-4b8d-b834-b8557d8d8f7a req-b137b9d2-09bb-4fef-9817-269f130f245d service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] No waiting events found dispatching network-vif-unplugged-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-2c5d4e71-df4e-4b8d-b834-b8557d8d8f7a req-b137b9d2-09bb-4fef-9817-269f130f245d service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received event network-vif-unplugged-659cda7f-6022-4c6d-b182-dd720257de0a for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:56:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Instance destroyed successfully.
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lazy-loading 'resources' on Instance uuid 6abb7439-ca84-4a8e-b444-d1a24fe07fde {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1036882410',display_name='tempest-VolumesActionsTest-instance-1036882410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1036882410',id=22,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:54:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fa968e78b2f4b8eac3f96aefa36aa4b',ramdisk_id='',reservation_id='r-j1d9l49z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-848179361',owner_user_name='tempest-VolumesActionsTest-848179361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:54:25Z,user_data=None,user_id='fa556ea48af74f00887d740c81841879',uuid=6abb7439-ca84-4a8e-b444-d1a24fe07fde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converting VIF {"id": "659cda7f-6022-4c6d-b182-dd720257de0a", "address": "fa:16:3e:52:b6:df", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap659cda7f-60", "ovs_interfaceid": "659cda7f-6022-4c6d-b182-dd720257de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:df,bridge_name='br-int',has_traffic_filtering=True,id=659cda7f-6022-4c6d-b182-dd720257de0a,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659cda7f-60') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG os_vif [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:df,bridge_name='br-int',has_traffic_filtering=True,id=659cda7f-6022-4c6d-b182-dd720257de0a,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659cda7f-60') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap659cda7f-60, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:10 user nova-compute[70659]: INFO os_vif [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:df,bridge_name='br-int',has_traffic_filtering=True,id=659cda7f-6022-4c6d-b182-dd720257de0a,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap659cda7f-60')
Jul 25 16:56:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Deleting instance files /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde_del
Jul 25 16:56:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Deletion of /opt/stack/data/nova/instances/6abb7439-ca84-4a8e-b444-d1a24fe07fde_del complete
Jul 25 16:56:10 user nova-compute[70659]: INFO nova.compute.manager [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 25 16:56:10 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:56:10 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:10 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Took 0.57 seconds to deallocate network for instance.
Jul 25 16:56:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:11 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Deleted allocations for instance 6abb7439-ca84-4a8e-b444-d1a24fe07fde
Jul 25 16:56:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7ef144d1-d45d-4e56-ac27-e3e39d26c1d2 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.112s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquiring lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:11 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:56:11 user nova-compute[70659]: INFO nova.compute.claims [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Claim successful on node user
Jul 25 16:56:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-7d335695-57c5-4864-be98-266b6b6b2d6e req-2d262ceb-74dd-4153-a9e6-29e5ecdec27f service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received event network-vif-plugged-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7d335695-57c5-4864-be98-266b6b6b2d6e req-2d262ceb-74dd-4153-a9e6-29e5ecdec27f service nova] Acquiring lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7d335695-57c5-4864-be98-266b6b6b2d6e req-2d262ceb-74dd-4153-a9e6-29e5ecdec27f service nova] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7d335695-57c5-4864-be98-266b6b6b2d6e req-2d262ceb-74dd-4153-a9e6-29e5ecdec27f service nova] Lock "6abb7439-ca84-4a8e-b444-d1a24fe07fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-7d335695-57c5-4864-be98-266b6b6b2d6e req-2d262ceb-74dd-4153-a9e6-29e5ecdec27f service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] No waiting events found dispatching network-vif-plugged-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:12 user nova-compute[70659]: WARNING nova.compute.manager [req-7d335695-57c5-4864-be98-266b6b6b2d6e req-2d262ceb-74dd-4153-a9e6-29e5ecdec27f service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received unexpected event network-vif-plugged-659cda7f-6022-4c6d-b182-dd720257de0a for instance with vm_state deleted and task_state None.
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-7d335695-57c5-4864-be98-266b6b6b2d6e req-2d262ceb-74dd-4153-a9e6-29e5ecdec27f service nova] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Received event network-vif-deleted-659cda7f-6022-4c6d-b182-dd720257de0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.network.neutron [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:56:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.policy [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c5ec2c97b3d4b088d72015e814aa6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3821de4688c640ea85dcb7dd783865d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:56:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Creating image(s)
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquiring lock "/opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "/opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "/opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.190s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk 1073741824" returned: 0 in 0.058s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.network.neutron [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Successfully created port: fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.170s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:56:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Cannot resize image /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG nova.objects.instance [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lazy-loading 'migration_context' on Instance uuid 0abf1dbe-c66a-40f1-9901-dc71a3c95850 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Ensure instance console log exists: /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Successfully updated port: fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquiring lock "refresh_cache-0abf1dbe-c66a-40f1-9901-dc71a3c95850" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquired lock "refresh_cache-0abf1dbe-c66a-40f1-9901-dc71a3c95850" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:56:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-f76bb5ac-9e53-45b8-b708-7a5b53f46d24 req-dd1d3299-781d-4a09-8098-f595bc6ad142 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received event network-changed-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-f76bb5ac-9e53-45b8-b708-7a5b53f46d24 req-dd1d3299-781d-4a09-8098-f595bc6ad142 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Refreshing instance network info cache due to event network-changed-fa736349-3467-47f3-ab7e-47fdc6d191db. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f76bb5ac-9e53-45b8-b708-7a5b53f46d24 req-dd1d3299-781d-4a09-8098-f595bc6ad142 service nova] Acquiring lock "refresh_cache-0abf1dbe-c66a-40f1-9901-dc71a3c95850" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.network.neutron [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Updating instance_info_cache with network_info: [{"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Releasing lock "refresh_cache-0abf1dbe-c66a-40f1-9901-dc71a3c95850" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Instance network_info: |[{"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f76bb5ac-9e53-45b8-b708-7a5b53f46d24 req-dd1d3299-781d-4a09-8098-f595bc6ad142 service nova] Acquired lock "refresh_cache-0abf1dbe-c66a-40f1-9901-dc71a3c95850" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.network.neutron [req-f76bb5ac-9e53-45b8-b708-7a5b53f46d24 req-dd1d3299-781d-4a09-8098-f595bc6ad142 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Refreshing network info cache for port fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Start _get_guest_xml network_info=[{"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:56:14 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:14 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2078469968',display_name='tempest-VolumesActionsTest-instance-2078469968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2078469968',id=26,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3821de4688c640ea85dcb7dd783865d3',ramdisk_id='',reservation_id='r-zhms2cz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-715820911',owner_user_name='tempest-VolumesActionsTest-715820911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:56:12Z,user_data=None,user_id='1c5ec2c97b3d4b088d72015e814aa6a8',uuid=0abf1dbe-c66a-40f1-9901-dc71a3c95850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Converting VIF {"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:66:32,bridge_name='br-int',has_traffic_filtering=True,id=fa736349-3467-47f3-ab7e-47fdc6d191db,network=Network(3b012e26-74d5-4ea3-81b5-ac95e4854c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa736349-34') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.objects.instance [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lazy-loading 'pci_devices' on Instance uuid 0abf1dbe-c66a-40f1-9901-dc71a3c95850 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:56:14 user nova-compute[70659]:   <uuid>0abf1dbe-c66a-40f1-9901-dc71a3c95850</uuid>
Jul 25 16:56:14 user nova-compute[70659]:   <name>instance-0000001a</name>
Jul 25 16:56:14 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:56:14 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:56:14 user nova-compute[70659]:   <metadata>
Jul 25 16:56:14 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:56:14 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:56:14 user nova-compute[70659]:       <nova:name>tempest-VolumesActionsTest-instance-2078469968</nova:name>
Jul 25 16:56:14 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:56:14</nova:creationTime>
Jul 25 16:56:14 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:56:14 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:56:14 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:56:14 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:56:14 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:56:14 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:56:14 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:56:14 user nova-compute[70659]:       <nova:owner>
Jul 25 16:56:14 user nova-compute[70659]:         <nova:user uuid="1c5ec2c97b3d4b088d72015e814aa6a8">tempest-VolumesActionsTest-715820911-project-member</nova:user>
Jul 25 16:56:14 user nova-compute[70659]:         <nova:project uuid="3821de4688c640ea85dcb7dd783865d3">tempest-VolumesActionsTest-715820911</nova:project>
Jul 25 16:56:14 user nova-compute[70659]:       </nova:owner>
Jul 25 16:56:14 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:56:14 user nova-compute[70659]:       <nova:ports>
Jul 25 16:56:14 user nova-compute[70659]:         <nova:port uuid="fa736349-3467-47f3-ab7e-47fdc6d191db">
Jul 25 16:56:14 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 16:56:14 user nova-compute[70659]:         </nova:port>
Jul 25 16:56:14 user nova-compute[70659]:       </nova:ports>
Jul 25 16:56:14 user nova-compute[70659]:     </nova:instance>
Jul 25 16:56:14 user nova-compute[70659]:   </metadata>
Jul 25 16:56:14 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:56:14 user nova-compute[70659]:     <system>
Jul 25 16:56:14 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:56:14 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:56:14 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:56:14 user nova-compute[70659]:       <entry name="serial">0abf1dbe-c66a-40f1-9901-dc71a3c95850</entry>
Jul 25 16:56:14 user nova-compute[70659]:       <entry name="uuid">0abf1dbe-c66a-40f1-9901-dc71a3c95850</entry>
Jul 25 16:56:14 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:56:14 user nova-compute[70659]:     </system>
Jul 25 16:56:14 user nova-compute[70659]:   </sysinfo>
Jul 25 16:56:14 user nova-compute[70659]:   <os>
Jul 25 16:56:14 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:56:14 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:56:14 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:56:14 user nova-compute[70659]:   </os>
Jul 25 16:56:14 user nova-compute[70659]:   <features>
Jul 25 16:56:14 user nova-compute[70659]:     <acpi/>
Jul 25 16:56:14 user nova-compute[70659]:     <apic/>
Jul 25 16:56:14 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:56:14 user nova-compute[70659]:   </features>
Jul 25 16:56:14 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:56:14 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:56:14 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:56:14 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:56:14 user nova-compute[70659]:   </clock>
Jul 25 16:56:14 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:56:14 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:56:14 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:56:14 user nova-compute[70659]:   </cpu>
Jul 25 16:56:14 user nova-compute[70659]:   <devices>
Jul 25 16:56:14 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:56:14 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:56:14 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk"/>
Jul 25 16:56:14 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:56:14 user nova-compute[70659]:     </disk>
Jul 25 16:56:14 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:56:14 user nova-compute[70659]:       <mac address="fa:16:3e:32:66:32"/>
Jul 25 16:56:14 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:56:14 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:56:14 user nova-compute[70659]:       <target dev="tapfa736349-34"/>
Jul 25 16:56:14 user nova-compute[70659]:     </interface>
Jul 25 16:56:14 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:56:14 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/console.log" append="off"/>
Jul 25 16:56:14 user nova-compute[70659]:     </serial>
Jul 25 16:56:14 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:56:14 user nova-compute[70659]:     <video>
Jul 25 16:56:14 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:56:14 user nova-compute[70659]:     </video>
Jul 25 16:56:14 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:56:14 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:56:14 user nova-compute[70659]:     </rng>
Jul 25 16:56:14 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:56:14 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:56:14 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:56:14 user nova-compute[70659]:     </memballoon>
Jul 25 16:56:14 user nova-compute[70659]:   </devices>
Jul 25 16:56:14 user nova-compute[70659]: </domain>
Jul 25 16:56:14 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2078469968',display_name='tempest-VolumesActionsTest-instance-2078469968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2078469968',id=26,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3821de4688c640ea85dcb7dd783865d3',ramdisk_id='',reservation_id='r-zhms2cz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-715820911',owner_user_name='tempest-VolumesActionsTest-715820911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:56:12Z,user_data=None,user_id='1c5ec2c97b3d4b088d72015e814aa6a8',uuid=0abf1dbe-c66a-40f1-9901-dc71a3c95850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Converting VIF {"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:66:32,bridge_name='br-int',has_traffic_filtering=True,id=fa736349-3467-47f3-ab7e-47fdc6d191db,network=Network(3b012e26-74d5-4ea3-81b5-ac95e4854c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa736349-34') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG os_vif [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:66:32,bridge_name='br-int',has_traffic_filtering=True,id=fa736349-3467-47f3-ab7e-47fdc6d191db,network=Network(3b012e26-74d5-4ea3-81b5-ac95e4854c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa736349-34') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa736349-34, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa736349-34, col_values=(('external_ids', {'iface-id': 'fa736349-3467-47f3-ab7e-47fdc6d191db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:66:32', 'vm-uuid': '0abf1dbe-c66a-40f1-9901-dc71a3c95850'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:14 user nova-compute[70659]: INFO os_vif [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:66:32,bridge_name='br-int',has_traffic_filtering=True,id=fa736349-3467-47f3-ab7e-47fdc6d191db,network=Network(3b012e26-74d5-4ea3-81b5-ac95e4854c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa736349-34')
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:56:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] No VIF found with MAC fa:16:3e:32:66:32, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-f76bb5ac-9e53-45b8-b708-7a5b53f46d24 req-dd1d3299-781d-4a09-8098-f595bc6ad142 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Updated VIF entry in instance network info cache for port fa736349-3467-47f3-ab7e-47fdc6d191db. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-f76bb5ac-9e53-45b8-b708-7a5b53f46d24 req-dd1d3299-781d-4a09-8098-f595bc6ad142 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Updating instance_info_cache with network_info: [{"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f76bb5ac-9e53-45b8-b708-7a5b53f46d24 req-dd1d3299-781d-4a09-8098-f595bc6ad142 service nova] Releasing lock "refresh_cache-0abf1dbe-c66a-40f1-9901-dc71a3c95850" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-f4fa053f-5dc5-4b85-adfe-a1b43627814d req-cc8f5b32-69b2-4582-878a-75bc047eed81 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received event network-vif-plugged-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f4fa053f-5dc5-4b85-adfe-a1b43627814d req-cc8f5b32-69b2-4582-878a-75bc047eed81 service nova] Acquiring lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f4fa053f-5dc5-4b85-adfe-a1b43627814d req-cc8f5b32-69b2-4582-878a-75bc047eed81 service nova] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f4fa053f-5dc5-4b85-adfe-a1b43627814d req-cc8f5b32-69b2-4582-878a-75bc047eed81 service nova] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-f4fa053f-5dc5-4b85-adfe-a1b43627814d req-cc8f5b32-69b2-4582-878a-75bc047eed81 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] No waiting events found dispatching network-vif-plugged-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:15 user nova-compute[70659]: WARNING nova.compute.manager [req-f4fa053f-5dc5-4b85-adfe-a1b43627814d req-cc8f5b32-69b2-4582-878a-75bc047eed81 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received unexpected event network-vif-plugged-fa736349-3467-47f3-ab7e-47fdc6d191db for instance with vm_state building and task_state spawning.
Jul 25 16:56:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304177.9009166, 0abf1dbe-c66a-40f1-9901-dc71a3c95850 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:17 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] VM Resumed (Lifecycle Event)
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:56:17 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Instance spawned successfully.
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:17 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304177.9054344, 0abf1dbe-c66a-40f1-9901-dc71a3c95850 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:17 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] VM Started (Lifecycle Event)
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:18 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:56:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-88fb3203-99c7-46f2-9fe5-957829228336 req-859409a8-8944-45c7-81d9-f714ca3f8198 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received event network-vif-plugged-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-88fb3203-99c7-46f2-9fe5-957829228336 req-859409a8-8944-45c7-81d9-f714ca3f8198 service nova] Acquiring lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-88fb3203-99c7-46f2-9fe5-957829228336 req-859409a8-8944-45c7-81d9-f714ca3f8198 service nova] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-88fb3203-99c7-46f2-9fe5-957829228336 req-859409a8-8944-45c7-81d9-f714ca3f8198 service nova] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-88fb3203-99c7-46f2-9fe5-957829228336 req-859409a8-8944-45c7-81d9-f714ca3f8198 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] No waiting events found dispatching network-vif-plugged-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:18 user nova-compute[70659]: WARNING nova.compute.manager [req-88fb3203-99c7-46f2-9fe5-957829228336 req-859409a8-8944-45c7-81d9-f714ca3f8198 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received unexpected event network-vif-plugged-fa736349-3467-47f3-ab7e-47fdc6d191db for instance with vm_state building and task_state spawning.
Jul 25 16:56:18 user nova-compute[70659]: INFO nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Took 5.77 seconds to spawn the instance on the hypervisor.
Jul 25 16:56:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:18 user nova-compute[70659]: INFO nova.compute.manager [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Took 6.58 seconds to build instance.
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-10f0b5c6-3bc9-40dc-b57e-893b92794763 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.687s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG nova.objects.instance [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:18 user nova-compute[70659]: INFO nova.compute.manager [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attaching volume a0b0d855-6759-4b6d-9914-baf14342e70e to /dev/vdb
Jul 25 16:56:18 user nova-compute[70659]: DEBUG os_brick.utils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efeb7d4-1e01-4f1c-a517-bb101bc0093a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa9b18c-c94d-41d5-96e8-4bc092b02f9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff811d44-1a1b-46d0-919a-b046b35ce005]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d9ee5e-a3d4-4c92-aaa6-2975155beac6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:56:18 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:56:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eba2ce-2359-4fe2-a2d7-c8ed735d1ae6]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG os_brick.utils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:56:18 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updating existing volume attachment record: 47bf3281-e02c-4fd6-b8f9-e7f2e7a7efdf {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:56:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-443da0b8-4209-41b0-aae5-52695adf0cc4 req-c5718ae1-3c98-4d6d-bf9e-88684394e9e7 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-changed-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-443da0b8-4209-41b0-aae5-52695adf0cc4 req-c5718ae1-3c98-4d6d-bf9e-88684394e9e7 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Refreshing instance network info cache due to event network-changed-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-443da0b8-4209-41b0-aae5-52695adf0cc4 req-c5718ae1-3c98-4d6d-bf9e-88684394e9e7 service nova] Acquiring lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-443da0b8-4209-41b0-aae5-52695adf0cc4 req-c5718ae1-3c98-4d6d-bf9e-88684394e9e7 service nova] Acquired lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-443da0b8-4209-41b0-aae5-52695adf0cc4 req-c5718ae1-3c98-4d6d-bf9e-88684394e9e7 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Refreshing network info cache for port 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG nova.objects.instance [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'flavor' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:21 user nova-compute[70659]: INFO nova.compute.manager [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Attaching volume 13d82a96-71af-43cd-ad85-419373af6b27 to /dev/vdb
Jul 25 16:56:21 user nova-compute[70659]: DEBUG os_brick.utils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:56:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac2191-4bfa-4a4e-9daa-bf34753843d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb419fa-3e3a-475a-95f7-5728f0e4ce49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c9151e-6e05-46dd-b80a-53535c135ed5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c1935-eaf2-43b3-9751-4b6cf5a9d242]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG nova.network.neutron [req-443da0b8-4209-41b0-aae5-52695adf0cc4 req-c5718ae1-3c98-4d6d-bf9e-88684394e9e7 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updated VIF entry in instance network info cache for port 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG nova.network.neutron [req-443da0b8-4209-41b0-aae5-52695adf0cc4 req-c5718ae1-3c98-4d6d-bf9e-88684394e9e7 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating instance_info_cache with network_info: [{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:56:22 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd7e331-43fb-4401-98f7-0ca9e0f8e38c]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG os_brick.utils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating existing volume attachment record: 7756a326-ec76-4329-862b-4c9c5c73d433 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:56:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-443da0b8-4209-41b0-aae5-52695adf0cc4 req-c5718ae1-3c98-4d6d-bf9e-88684394e9e7 service nova] Releasing lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:56:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:25 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304170.1039774, 6abb7439-ca84-4a8e-b444-d1a24fe07fde => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:25 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] VM Stopped (Lifecycle Event)
Jul 25 16:56:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0ecda3b1-518f-4c3c-aa57-defdb8852ea2 None None] [instance: 6abb7439-ca84-4a8e-b444-d1a24fe07fde] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:56:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBYIDqam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:56:25 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:56:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:56:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:56:25 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:56:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:56:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:56:25 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:56:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cebae27-3404-4d62-bcfe-34378ad9cd0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:56:26 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36f16df-7056-43f8-a88a-be34888bf5e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e] added
Jul 25 16:56:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7416a4-4fed-47de-b709-f25f55be3951]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d992c0-4970-4cde-aa34-6c472011f05a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBYIDqam {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBYIDqam" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f010f302-a3e1-4b0a-be50-4ecc0b2688d6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBYIDqam'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c22b9f6-e729-4207-ae60-3afaccc13487]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab5b9f1-88c9-4e2e-8d04-d65c4a7888ac]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d6c810-ed9c-44c6-8301-a906323e3680]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e, portal: 172.16.0.220,3260]
Jul 25 16:56:26 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e, portal: 172.16.0.220,3260] successful.
Jul 25 16:56:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68e5c71-de31-4e8b-8832-8cc5dc11521a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[669f9e23-0c61-41fa-af52-fb3bd0051877]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:26 user nova-compute[70659]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)
Jul 25 16:56:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:26 user nova-compute[70659]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)
Jul 25 16:56:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d357c03e-4891-444a-b682-bb8d99df1eca]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBYIDqam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:56:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:56:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23931383266333038', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:56:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931383266333038', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:56:27 user nova-compute[70659]: DEBUG nova.objects.instance [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:56:27 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:56:27 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:56:27 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:56:27 user nova-compute[70659]:   <serial>a0b0d855-6759-4b6d-9914-baf14342e70e</serial>
Jul 25 16:56:27 user nova-compute[70659]: </disk>
Jul 25 16:56:27 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:56:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:56:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:56:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No VIF found with MAC fa:16:3e:56:91:c8, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:56:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3c15671b-fe2a-410f-83fc-0e53a071f105 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.284s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqcRZtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:56:29 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:56:29 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:56:29 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d14778f-d9c9-42f1-8855-781563e4087d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:56:29 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[05189e1e-d9be-45f0-b2c9-218d2bf54feb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27] added
Jul 25 16:56:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9740d61-a9c7-4c97-ab7f-787f6191e859]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4788b63-d566-4ee3-af6f-dee58fe8b919]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqcRZtlV {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqcRZtlV" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d1eff6-9402-44c6-b678-126c715881de]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqcRZtlV'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f85c360-47cf-4a4d-b2b4-f5c9e739b813]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[432c9fb0-d2a0-441a-9bc4-94c86b7c35e8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:29 user nova-compute[70659]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)
Jul 25 16:56:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:29 user nova-compute[70659]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)
Jul 25 16:56:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aba92d4-7fcb-401f-962b-fa9dd64cd4df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27, portal: 172.16.0.220,3260]
Jul 25 16:56:29 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27, portal: 172.16.0.220,3260] successful.
Jul 25 16:56:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad0669a-9c86-48d3-a57e-7548452cc2c3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde2926d-b639-4ce5-aca8-11ee5b08ab4e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:29 user nova-compute[70659]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)
Jul 25 16:56:29 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:56:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:29 user nova-compute[70659]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)
Jul 25 16:56:29 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:56:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[650427a8-3d69-40e2-969e-5e87e7ce94b1]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:56:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqcRZtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:30 user nova-compute[70659]: INFO nova.compute.manager [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Detaching volume a0b0d855-6759-4b6d-9914-baf14342e70e
Jul 25 16:56:30 user nova-compute[70659]: INFO nova.virt.block_device [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attempting to driver detach volume a0b0d855-6759-4b6d-9914-baf14342e70e from mountpoint /dev/vdb
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Attempting to detach device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:56:30 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:56:30 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:56:30 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:56:30 user nova-compute[70659]:   <serial>a0b0d855-6759-4b6d-9914-baf14342e70e</serial>
Jul 25 16:56:30 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:56:30 user nova-compute[70659]: </disk>
Jul 25 16:56:30 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:56:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully detached device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the persistent domain config.
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:56:30 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:56:30 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:56:30 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:56:30 user nova-compute[70659]:   <serial>a0b0d855-6759-4b6d-9914-baf14342e70e</serial>
Jul 25 16:56:30 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:56:30 user nova-compute[70659]: </disk>
Jul 25 16:56:30 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23133396439616463', 'path': '/dev/sdd'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133396439616463', 'path': '/dev/sdd'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.objects.instance [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'flavor' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:56:30 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:56:30 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 16:56:30 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:56:30 user nova-compute[70659]:   <serial>13d82a96-71af-43cd-ad85-419373af6b27</serial>
Jul 25 16:56:30 user nova-compute[70659]: </disk>
Jul 25 16:56:30 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304190.7036088, f6fba6f6-ff72-43c2-b824-f262bf430eac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:56:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully detached device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the live domain config.
Jul 25 16:56:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBYIDqam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:56:30 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ee71c-c081-4ec4-ab8e-59278082b713]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d6b8df-7cc9-440b-81a0-f1265d46dede]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:30 user nova-compute[70659]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)
Jul 25 16:56:30 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:56:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:56:30 user nova-compute[70659]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e (non-flash)
Jul 25 16:56:30 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:56:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd306ce5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d840c909-0445-4227-b0ca-006a3e75c512]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b749b9-893c-4ac2-994e-61a1ed76be03]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6850e4-6a02-4302-bb09-33be3597eec6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d10dd9a-5f82-412b-bf3c-84256d64bf74]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a9063d-07c1-4f01-b075-7e336c5485e4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f935c1eb-24c2-495b-a41d-59b186cd61e4]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e, portal: 172.16.0.220,3260]
Jul 25 16:56:30 user nova-compute[70659]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e, portal: 172.16.0.220,3260] successful.
Jul 25 16:56:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0b0d855-6759-4b6d-9914-baf14342e70e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a60c977-14b8-434b-b87b-3fd2a770b536]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== disconnect_volume: return (293ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No VIF found with MAC fa:16:3e:e1:da:ad, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c9d79190-f07b-485f-bae0-94c3d1d48e8d tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.563s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG nova.objects.instance [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5061c466-7aab-4489-a45f-8dca096189ab tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.692s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:31 user nova-compute[70659]: INFO nova.compute.manager [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Rescuing
Jul 25 16:56:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquired lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:56:31 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:56:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating instance_info_cache with network_info: [{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Releasing lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:56:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.compute.manager [req-a0024da6-1095-494d-8932-6cdcecd3fd35 req-5dbbb2c6-4918-4f67-9d35-dd6877ae9d18 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a0024da6-1095-494d-8932-6cdcecd3fd35 req-5dbbb2c6-4918-4f67-9d35-dd6877ae9d18 service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a0024da6-1095-494d-8932-6cdcecd3fd35 req-5dbbb2c6-4918-4f67-9d35-dd6877ae9d18 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a0024da6-1095-494d-8932-6cdcecd3fd35 req-5dbbb2c6-4918-4f67-9d35-dd6877ae9d18 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.compute.manager [req-a0024da6-1095-494d-8932-6cdcecd3fd35 req-5dbbb2c6-4918-4f67-9d35-dd6877ae9d18 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:33 user nova-compute[70659]: WARNING nova.compute.manager [req-a0024da6-1095-494d-8932-6cdcecd3fd35 req-5dbbb2c6-4918-4f67-9d35-dd6877ae9d18 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state active and task_state rescuing.
Jul 25 16:56:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Instance destroyed successfully.
Jul 25 16:56:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Attempting rescue
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70659) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Instance directory exists: not creating {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 16:56:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Creating image(s)
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'trusted_certs' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue" returned: 0 in 0.050s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'migration_context' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Start _get_guest_xml network_info=[{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "vif_mac": "fa:16:3e:e1:da:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'resources' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'numa_topology' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1644944333',display_name='tempest-ServerRescueNegativeTestJSON-server-1644944333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1644944333',id=23,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4jhIgOnxMQ5hodwDxhkvFAV/jzlx2MOi4HvSNeJhJQiQaz+EGM3gY5tYAvVpFFq2DgsXfMEUphY9/W2Cum8qMezySKtcW3KY6sqG6Ms5RpptV/IsBe9BWa/fEzK7lIfg==',key_name='tempest-keypair-1807504337',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-ihgike6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=51c336bc-e646-4429-809d-354ae03bd8d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "vif_mac": "fa:16:3e:e1:da:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "vif_mac": "fa:16:3e:e1:da:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:da:ad,bridge_name='br-int',has_traffic_filtering=True,id=5eb397f0-b9a0-4bb7-a2e7-47b497485cf2,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eb397f0-b9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'pci_devices' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:56:33 user nova-compute[70659]:   <uuid>51c336bc-e646-4429-809d-354ae03bd8d6</uuid>
Jul 25 16:56:33 user nova-compute[70659]:   <name>instance-00000017</name>
Jul 25 16:56:33 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:56:33 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:56:33 user nova-compute[70659]:   <metadata>
Jul 25 16:56:33 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:56:33 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:56:33 user nova-compute[70659]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1644944333</nova:name>
Jul 25 16:56:33 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:56:33</nova:creationTime>
Jul 25 16:56:33 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:56:33 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:56:33 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:56:33 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:56:33 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:56:33 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:56:33 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:56:33 user nova-compute[70659]:       <nova:owner>
Jul 25 16:56:33 user nova-compute[70659]:         <nova:user uuid="9aaa70e5cce7418b96837e30769ac6aa">tempest-ServerRescueNegativeTestJSON-1539045365-project-member</nova:user>
Jul 25 16:56:33 user nova-compute[70659]:         <nova:project uuid="d20acc57667b418ba16f573fe81841ac">tempest-ServerRescueNegativeTestJSON-1539045365</nova:project>
Jul 25 16:56:33 user nova-compute[70659]:       </nova:owner>
Jul 25 16:56:33 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:56:33 user nova-compute[70659]:       <nova:ports>
Jul 25 16:56:33 user nova-compute[70659]:         <nova:port uuid="5eb397f0-b9a0-4bb7-a2e7-47b497485cf2">
Jul 25 16:56:33 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 16:56:33 user nova-compute[70659]:         </nova:port>
Jul 25 16:56:33 user nova-compute[70659]:       </nova:ports>
Jul 25 16:56:33 user nova-compute[70659]:     </nova:instance>
Jul 25 16:56:33 user nova-compute[70659]:   </metadata>
Jul 25 16:56:33 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:56:33 user nova-compute[70659]:     <system>
Jul 25 16:56:33 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:56:33 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:56:33 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:56:33 user nova-compute[70659]:       <entry name="serial">51c336bc-e646-4429-809d-354ae03bd8d6</entry>
Jul 25 16:56:33 user nova-compute[70659]:       <entry name="uuid">51c336bc-e646-4429-809d-354ae03bd8d6</entry>
Jul 25 16:56:33 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:56:33 user nova-compute[70659]:     </system>
Jul 25 16:56:33 user nova-compute[70659]:   </sysinfo>
Jul 25 16:56:33 user nova-compute[70659]:   <os>
Jul 25 16:56:33 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:56:33 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:56:33 user nova-compute[70659]:   </os>
Jul 25 16:56:33 user nova-compute[70659]:   <features>
Jul 25 16:56:33 user nova-compute[70659]:     <acpi/>
Jul 25 16:56:33 user nova-compute[70659]:     <apic/>
Jul 25 16:56:33 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:56:33 user nova-compute[70659]:   </features>
Jul 25 16:56:33 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:56:33 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:56:33 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:56:33 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:56:33 user nova-compute[70659]:   </clock>
Jul 25 16:56:33 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:56:33 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:56:33 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:56:33 user nova-compute[70659]:   </cpu>
Jul 25 16:56:33 user nova-compute[70659]:   <devices>
Jul 25 16:56:33 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:56:33 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:56:33 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue"/>
Jul 25 16:56:33 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:56:33 user nova-compute[70659]:     </disk>
Jul 25 16:56:33 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:56:33 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:56:33 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk"/>
Jul 25 16:56:33 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 16:56:33 user nova-compute[70659]:     </disk>
Jul 25 16:56:33 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:56:33 user nova-compute[70659]:       <mac address="fa:16:3e:e1:da:ad"/>
Jul 25 16:56:33 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:56:33 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:56:33 user nova-compute[70659]:       <target dev="tap5eb397f0-b9"/>
Jul 25 16:56:33 user nova-compute[70659]:     </interface>
Jul 25 16:56:33 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:56:33 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/console.log" append="off"/>
Jul 25 16:56:33 user nova-compute[70659]:     </serial>
Jul 25 16:56:33 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:56:33 user nova-compute[70659]:     <video>
Jul 25 16:56:33 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:56:33 user nova-compute[70659]:     </video>
Jul 25 16:56:33 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:56:33 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:56:33 user nova-compute[70659]:     </rng>
Jul 25 16:56:33 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:56:33 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:56:33 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:56:33 user nova-compute[70659]:     </memballoon>
Jul 25 16:56:33 user nova-compute[70659]:   </devices>
Jul 25 16:56:33 user nova-compute[70659]: </domain>
Jul 25 16:56:33 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:56:34 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Instance destroyed successfully.
Jul 25 16:56:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:56:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:56:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] No VIF found with MAC fa:16:3e:e1:da:ad, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:56:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-2324f4eb-c78f-4452-a8e1-c4e11f3a87f1 req-8ac6791c-e366-478a-a9c9-9962f1fa1d59 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2324f4eb-c78f-4452-a8e1-c4e11f3a87f1 req-8ac6791c-e366-478a-a9c9-9962f1fa1d59 service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2324f4eb-c78f-4452-a8e1-c4e11f3a87f1 req-8ac6791c-e366-478a-a9c9-9962f1fa1d59 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2324f4eb-c78f-4452-a8e1-c4e11f3a87f1 req-8ac6791c-e366-478a-a9c9-9962f1fa1d59 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-2324f4eb-c78f-4452-a8e1-c4e11f3a87f1 req-8ac6791c-e366-478a-a9c9-9962f1fa1d59 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:35 user nova-compute[70659]: WARNING nova.compute.manager [req-2324f4eb-c78f-4452-a8e1-c4e11f3a87f1 req-8ac6791c-e366-478a-a9c9-9962f1fa1d59 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state active and task_state rescuing.
Jul 25 16:56:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:56:35 user nova-compute[70659]: INFO nova.compute.claims [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Claim successful on node user
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:56:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.policy [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a77a77d2b1954c10ace66ba38fd9ff6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de6ba95db444b5b10d51ef16525948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:56:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Creating image(s)
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "/opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "/opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk 1073741824" returned: 0 in 0.050s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Cannot resize image /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'migration_context' on Instance uuid 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Ensure instance console log exists: /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Successfully created port: 9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:37 user nova-compute[70659]: WARNING nova.compute.manager [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state active and task_state rescuing.
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:37 user nova-compute[70659]: WARNING nova.compute.manager [req-de282597-a81a-4069-9f40-6fa975e24fd3 req-1e3215e5-2bb7-4c3b-84a7-b9b55b7dd161 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state active and task_state rescuing.
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for 51c336bc-e646-4429-809d-354ae03bd8d6 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304197.5415535, 51c336bc-e646-4429-809d-354ae03bd8d6 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] VM Resumed (Lifecycle Event)
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dccccca5-cd1c-43ce-874a-abccbf617ace tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304197.5480728, 51c336bc-e646-4429-809d-354ae03bd8d6 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] VM Started (Lifecycle Event)
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Successfully updated port: 9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "refresh_cache-4d852fe8-32e2-447d-8e78-f7093db56d6b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquired lock "refresh_cache-4d852fe8-32e2-447d-8e78-f7093db56d6b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-7623c926-e093-423e-bf3f-97b1a3d6bb70 req-96ab4bb9-42a9-4ba6-babf-f3af99979d30 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-changed-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-7623c926-e093-423e-bf3f-97b1a3d6bb70 req-96ab4bb9-42a9-4ba6-babf-f3af99979d30 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Refreshing instance network info cache due to event network-changed-9ee6940c-69cd-42ac-841f-4a81a6f1bda8. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7623c926-e093-423e-bf3f-97b1a3d6bb70 req-96ab4bb9-42a9-4ba6-babf-f3af99979d30 service nova] Acquiring lock "refresh_cache-4d852fe8-32e2-447d-8e78-f7093db56d6b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Updating instance_info_cache with network_info: [{"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Releasing lock "refresh_cache-4d852fe8-32e2-447d-8e78-f7093db56d6b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Instance network_info: |[{"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7623c926-e093-423e-bf3f-97b1a3d6bb70 req-96ab4bb9-42a9-4ba6-babf-f3af99979d30 service nova] Acquired lock "refresh_cache-4d852fe8-32e2-447d-8e78-f7093db56d6b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-7623c926-e093-423e-bf3f-97b1a3d6bb70 req-96ab4bb9-42a9-4ba6-babf-f3af99979d30 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Refreshing network info cache for port 9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Start _get_guest_xml network_info=[{"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:56:38 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:38 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1633613734',display_name='tempest-AttachVolumeTestJSON-server-1633613734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1633613734',id=27,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZiJbJHAX9Z7xTi8P+5WAn/yVNmiuBXLo7+nMtvi+qkyHPnxehGryMN6g/fP94Iki//wlhKyNcPS8q4k6NX4z1P8R5vFh0GDljGKzVf47Scg398AiRv8N0ncex74qQf8A==',key_name='tempest-keypair-721637731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-c6ya5h7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=4d852fe8-32e2-447d-8e78-f7093db56d6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:69:77,bridge_name='br-int',has_traffic_filtering=True,id=9ee6940c-69cd-42ac-841f-4a81a6f1bda8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6940c-69') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:56:38 user nova-compute[70659]:   <uuid>4d852fe8-32e2-447d-8e78-f7093db56d6b</uuid>
Jul 25 16:56:38 user nova-compute[70659]:   <name>instance-0000001b</name>
Jul 25 16:56:38 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:56:38 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:56:38 user nova-compute[70659]:   <metadata>
Jul 25 16:56:38 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:56:38 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:56:38 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeTestJSON-server-1633613734</nova:name>
Jul 25 16:56:38 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:56:38</nova:creationTime>
Jul 25 16:56:38 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:56:38 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:56:38 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:56:38 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:56:38 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:56:38 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:56:38 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:56:38 user nova-compute[70659]:       <nova:owner>
Jul 25 16:56:38 user nova-compute[70659]:         <nova:user uuid="a77a77d2b1954c10ace66ba38fd9ff6c">tempest-AttachVolumeTestJSON-212658614-project-member</nova:user>
Jul 25 16:56:38 user nova-compute[70659]:         <nova:project uuid="07de6ba95db444b5b10d51ef16525948">tempest-AttachVolumeTestJSON-212658614</nova:project>
Jul 25 16:56:38 user nova-compute[70659]:       </nova:owner>
Jul 25 16:56:38 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:56:38 user nova-compute[70659]:       <nova:ports>
Jul 25 16:56:38 user nova-compute[70659]:         <nova:port uuid="9ee6940c-69cd-42ac-841f-4a81a6f1bda8">
Jul 25 16:56:38 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 16:56:38 user nova-compute[70659]:         </nova:port>
Jul 25 16:56:38 user nova-compute[70659]:       </nova:ports>
Jul 25 16:56:38 user nova-compute[70659]:     </nova:instance>
Jul 25 16:56:38 user nova-compute[70659]:   </metadata>
Jul 25 16:56:38 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:56:38 user nova-compute[70659]:     <system>
Jul 25 16:56:38 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:56:38 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:56:38 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:56:38 user nova-compute[70659]:       <entry name="serial">4d852fe8-32e2-447d-8e78-f7093db56d6b</entry>
Jul 25 16:56:38 user nova-compute[70659]:       <entry name="uuid">4d852fe8-32e2-447d-8e78-f7093db56d6b</entry>
Jul 25 16:56:38 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:56:38 user nova-compute[70659]:     </system>
Jul 25 16:56:38 user nova-compute[70659]:   </sysinfo>
Jul 25 16:56:38 user nova-compute[70659]:   <os>
Jul 25 16:56:38 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:56:38 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:56:38 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:56:38 user nova-compute[70659]:   </os>
Jul 25 16:56:38 user nova-compute[70659]:   <features>
Jul 25 16:56:38 user nova-compute[70659]:     <acpi/>
Jul 25 16:56:38 user nova-compute[70659]:     <apic/>
Jul 25 16:56:38 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:56:38 user nova-compute[70659]:   </features>
Jul 25 16:56:38 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:56:38 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:56:38 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:56:38 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:56:38 user nova-compute[70659]:   </clock>
Jul 25 16:56:38 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:56:38 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:56:38 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:56:38 user nova-compute[70659]:   </cpu>
Jul 25 16:56:38 user nova-compute[70659]:   <devices>
Jul 25 16:56:38 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:56:38 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:56:38 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk"/>
Jul 25 16:56:38 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:56:38 user nova-compute[70659]:     </disk>
Jul 25 16:56:38 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:56:38 user nova-compute[70659]:       <mac address="fa:16:3e:63:69:77"/>
Jul 25 16:56:38 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:56:38 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:56:38 user nova-compute[70659]:       <target dev="tap9ee6940c-69"/>
Jul 25 16:56:38 user nova-compute[70659]:     </interface>
Jul 25 16:56:38 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:56:38 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/console.log" append="off"/>
Jul 25 16:56:38 user nova-compute[70659]:     </serial>
Jul 25 16:56:38 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:56:38 user nova-compute[70659]:     <video>
Jul 25 16:56:38 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:56:38 user nova-compute[70659]:     </video>
Jul 25 16:56:38 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:56:38 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:56:38 user nova-compute[70659]:     </rng>
Jul 25 16:56:38 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:56:38 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:56:38 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:56:38 user nova-compute[70659]:     </memballoon>
Jul 25 16:56:38 user nova-compute[70659]:   </devices>
Jul 25 16:56:38 user nova-compute[70659]: </domain>
Jul 25 16:56:38 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1633613734',display_name='tempest-AttachVolumeTestJSON-server-1633613734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1633613734',id=27,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZiJbJHAX9Z7xTi8P+5WAn/yVNmiuBXLo7+nMtvi+qkyHPnxehGryMN6g/fP94Iki//wlhKyNcPS8q4k6NX4z1P8R5vFh0GDljGKzVf47Scg398AiRv8N0ncex74qQf8A==',key_name='tempest-keypair-721637731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-c6ya5h7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=4d852fe8-32e2-447d-8e78-f7093db56d6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:69:77,bridge_name='br-int',has_traffic_filtering=True,id=9ee6940c-69cd-42ac-841f-4a81a6f1bda8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6940c-69') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG os_vif [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:69:77,bridge_name='br-int',has_traffic_filtering=True,id=9ee6940c-69cd-42ac-841f-4a81a6f1bda8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6940c-69') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ee6940c-69, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9ee6940c-69, col_values=(('external_ids', {'iface-id': '9ee6940c-69cd-42ac-841f-4a81a6f1bda8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:69:77', 'vm-uuid': '4d852fe8-32e2-447d-8e78-f7093db56d6b'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:56:38 user nova-compute[70659]: INFO os_vif [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:69:77,bridge_name='br-int',has_traffic_filtering=True,id=9ee6940c-69cd-42ac-841f-4a81a6f1bda8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6940c-69')
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:56:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No VIF found with MAC fa:16:3e:63:69:77, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:56:39 user nova-compute[70659]: DEBUG nova.network.neutron [req-7623c926-e093-423e-bf3f-97b1a3d6bb70 req-96ab4bb9-42a9-4ba6-babf-f3af99979d30 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Updated VIF entry in instance network info cache for port 9ee6940c-69cd-42ac-841f-4a81a6f1bda8. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:56:39 user nova-compute[70659]: DEBUG nova.network.neutron [req-7623c926-e093-423e-bf3f-97b1a3d6bb70 req-96ab4bb9-42a9-4ba6-babf-f3af99979d30 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Updating instance_info_cache with network_info: [{"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7623c926-e093-423e-bf3f-97b1a3d6bb70 req-96ab4bb9-42a9-4ba6-babf-f3af99979d30 service nova] Releasing lock "refresh_cache-4d852fe8-32e2-447d-8e78-f7093db56d6b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-626876d0-48d6-4d38-8d90-36c28d83541e req-9d604440-749c-4702-8a83-5a8a10d3b7ca service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-626876d0-48d6-4d38-8d90-36c28d83541e req-9d604440-749c-4702-8a83-5a8a10d3b7ca service nova] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-626876d0-48d6-4d38-8d90-36c28d83541e req-9d604440-749c-4702-8a83-5a8a10d3b7ca service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-626876d0-48d6-4d38-8d90-36c28d83541e req-9d604440-749c-4702-8a83-5a8a10d3b7ca service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-626876d0-48d6-4d38-8d90-36c28d83541e req-9d604440-749c-4702-8a83-5a8a10d3b7ca service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] No waiting events found dispatching network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:40 user nova-compute[70659]: WARNING nova.compute.manager [req-626876d0-48d6-4d38-8d90-36c28d83541e req-9d604440-749c-4702-8a83-5a8a10d3b7ca service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received unexpected event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 for instance with vm_state building and task_state spawning.
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:40 user nova-compute[70659]: INFO nova.compute.manager [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Terminating instance
Jul 25 16:56:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-68fd2598-a3c3-4fd3-9719-6588cca7b711 req-dd1b2144-35e3-49da-b6f7-c939817a30f8 service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received event network-vif-unplugged-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-68fd2598-a3c3-4fd3-9719-6588cca7b711 req-dd1b2144-35e3-49da-b6f7-c939817a30f8 service nova] Acquiring lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-68fd2598-a3c3-4fd3-9719-6588cca7b711 req-dd1b2144-35e3-49da-b6f7-c939817a30f8 service nova] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-68fd2598-a3c3-4fd3-9719-6588cca7b711 req-dd1b2144-35e3-49da-b6f7-c939817a30f8 service nova] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-68fd2598-a3c3-4fd3-9719-6588cca7b711 req-dd1b2144-35e3-49da-b6f7-c939817a30f8 service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] No waiting events found dispatching network-vif-unplugged-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-68fd2598-a3c3-4fd3-9719-6588cca7b711 req-dd1b2144-35e3-49da-b6f7-c939817a30f8 service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received event network-vif-unplugged-1041c77a-2c7a-4b34-86ae-a433671fd870 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Instance destroyed successfully.
Jul 25 16:56:41 user nova-compute[70659]: DEBUG nova.objects.instance [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lazy-loading 'resources' on Instance uuid fc8e1bf8-976e-4c55-ad33-798cf40234e5 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-763003661',display_name='tempest-VolumesAdminNegativeTest-server-763003661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-763003661',id=24,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1548931d431b4da4859656f41b33a88c',ramdisk_id='',reservation_id='r-qm2lo0nf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-863505829',owner_user_name='tempest-VolumesAdminNegativeTest-863505829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:54:50Z,user_data=None,user_id='a55ce1dcf3eb4f7da9ce20dbc7e432c0',uuid=fc8e1bf8-976e-4c55-ad33-798cf40234e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converting VIF {"id": "1041c77a-2c7a-4b34-86ae-a433671fd870", "address": "fa:16:3e:3e:9e:31", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1041c77a-2c", "ovs_interfaceid": "1041c77a-2c7a-4b34-86ae-a433671fd870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:31,bridge_name='br-int',has_traffic_filtering=True,id=1041c77a-2c7a-4b34-86ae-a433671fd870,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1041c77a-2c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG os_vif [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:31,bridge_name='br-int',has_traffic_filtering=True,id=1041c77a-2c7a-4b34-86ae-a433671fd870,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1041c77a-2c') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1041c77a-2c, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:56:41 user nova-compute[70659]: INFO os_vif [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9e:31,bridge_name='br-int',has_traffic_filtering=True,id=1041c77a-2c7a-4b34-86ae-a433671fd870,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1041c77a-2c')
Jul 25 16:56:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Deleting instance files /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5_del
Jul 25 16:56:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Deletion of /opt/stack/data/nova/instances/fc8e1bf8-976e-4c55-ad33-798cf40234e5_del complete
Jul 25 16:56:41 user nova-compute[70659]: INFO nova.compute.manager [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 25 16:56:41 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:56:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd80a275-353c-450d-9965-bdae0917c202 req-79edc956-ef1a-42b7-bacd-c6ec44c0d791 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd80a275-353c-450d-9965-bdae0917c202 req-79edc956-ef1a-42b7-bacd-c6ec44c0d791 service nova] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd80a275-353c-450d-9965-bdae0917c202 req-79edc956-ef1a-42b7-bacd-c6ec44c0d791 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd80a275-353c-450d-9965-bdae0917c202 req-79edc956-ef1a-42b7-bacd-c6ec44c0d791 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd80a275-353c-450d-9965-bdae0917c202 req-79edc956-ef1a-42b7-bacd-c6ec44c0d791 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] No waiting events found dispatching network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:42 user nova-compute[70659]: WARNING nova.compute.manager [req-fd80a275-353c-450d-9965-bdae0917c202 req-79edc956-ef1a-42b7-bacd-c6ec44c0d791 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received unexpected event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 for instance with vm_state building and task_state spawning.
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304202.5723803, 4d852fe8-32e2-447d-8e78-f7093db56d6b => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] VM Resumed (Lifecycle Event)
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:56:42 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Instance spawned successfully.
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:42 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Took 1.09 seconds to deallocate network for instance.
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:56:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304202.5727713, 4d852fe8-32e2-447d-8e78-f7093db56d6b => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] VM Started (Lifecycle Event)
Jul 25 16:56:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:56:42 user nova-compute[70659]: INFO nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Took 6.43 seconds to spawn the instance on the hypervisor.
Jul 25 16:56:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:56:42 user nova-compute[70659]: INFO nova.compute.manager [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Took 7.22 seconds to build instance.
Jul 25 16:56:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fa70209d-4dbb-457b-90d1-81e2f1201a78 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.324s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-e1cb4bed-8bf2-46e2-a17a-61f23af409d5 req-b67f5a85-701e-4d3f-ac9e-f2123bc83110 service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received event network-vif-plugged-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e1cb4bed-8bf2-46e2-a17a-61f23af409d5 req-b67f5a85-701e-4d3f-ac9e-f2123bc83110 service nova] Acquiring lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e1cb4bed-8bf2-46e2-a17a-61f23af409d5 req-b67f5a85-701e-4d3f-ac9e-f2123bc83110 service nova] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e1cb4bed-8bf2-46e2-a17a-61f23af409d5 req-b67f5a85-701e-4d3f-ac9e-f2123bc83110 service nova] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-e1cb4bed-8bf2-46e2-a17a-61f23af409d5 req-b67f5a85-701e-4d3f-ac9e-f2123bc83110 service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] No waiting events found dispatching network-vif-plugged-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:56:43 user nova-compute[70659]: WARNING nova.compute.manager [req-e1cb4bed-8bf2-46e2-a17a-61f23af409d5 req-b67f5a85-701e-4d3f-ac9e-f2123bc83110 service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received unexpected event network-vif-plugged-1041c77a-2c7a-4b34-86ae-a433671fd870 for instance with vm_state deleted and task_state None.
Jul 25 16:56:43 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:56:43 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:56:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:43 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Deleted allocations for instance fc8e1bf8-976e-4c55-ad33-798cf40234e5
Jul 25 16:56:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90cd20d0-f954-4164-8555-9582cd9dfd37 tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "fc8e1bf8-976e-4c55-ad33-798cf40234e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.641s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-d30857f2-b14b-4423-992e-dfffe3f5313e req-3a71b11e-cdb8-4997-9a1c-5003faa93262 service nova] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Received event network-vif-deleted-1041c77a-2c7a-4b34-86ae-a433671fd870 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:56:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 16:56:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:56:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:56:54 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:54 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7142MB free_disk=25.240306854248047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 743875b3-2013-4162-9940-f1f59ca6c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f6fba6f6-ff72-43c2-b824-f262bf430eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 51c336bc-e646-4429-809d-354ae03bd8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f8fe25a3-fe0b-40a6-ad75-cdef0924154d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0abf1dbe-c66a-40f1-9901-dc71a3c95850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 4d852fe8-32e2-447d-8e78-f7093db56d6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 16:56:56 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304201.3987179, fc8e1bf8-976e-4c55-ad33-798cf40234e5 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:56:56 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] VM Stopped (Lifecycle Event)
Jul 25 16:56:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bd4639cf-9390-40f3-a956-e3f1803e91ef None None] [instance: fc8e1bf8-976e-4c55-ad33-798cf40234e5] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:56:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:56:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updating instance_info_cache with network_info: [{"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:56:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:56:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "12231bca-69a7-4cc4-a7bf-959d4c818339" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:57:01 user nova-compute[70659]: INFO nova.compute.claims [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Claim successful on node user
Jul 25 16:57:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:57:01 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.policy [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa556ea48af74f00887d740c81841879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa968e78b2f4b8eac3f96aefa36aa4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:57:01 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Creating image(s)
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "/opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "/opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "/opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk 1073741824" returned: 0 in 0.050s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Successfully created port: 48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Cannot resize image /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lazy-loading 'migration_context' on Instance uuid 12231bca-69a7-4cc4-a7bf-959d4c818339 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Ensure instance console log exists: /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Successfully updated port: 48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "refresh_cache-12231bca-69a7-4cc4-a7bf-959d4c818339" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquired lock "refresh_cache-12231bca-69a7-4cc4-a7bf-959d4c818339" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-cdb40bcd-f04c-4db2-81ee-81dea4c1dbb5 req-622003ef-8eaa-457c-b615-04e94b871d3e service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received event network-changed-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-cdb40bcd-f04c-4db2-81ee-81dea4c1dbb5 req-622003ef-8eaa-457c-b615-04e94b871d3e service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Refreshing instance network info cache due to event network-changed-48919998-7805-43ca-b9dc-11bf1e3015ee. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cdb40bcd-f04c-4db2-81ee-81dea4c1dbb5 req-622003ef-8eaa-457c-b615-04e94b871d3e service nova] Acquiring lock "refresh_cache-12231bca-69a7-4cc4-a7bf-959d4c818339" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Updating instance_info_cache with network_info: [{"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Releasing lock "refresh_cache-12231bca-69a7-4cc4-a7bf-959d4c818339" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Instance network_info: |[{"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cdb40bcd-f04c-4db2-81ee-81dea4c1dbb5 req-622003ef-8eaa-457c-b615-04e94b871d3e service nova] Acquired lock "refresh_cache-12231bca-69a7-4cc4-a7bf-959d4c818339" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.network.neutron [req-cdb40bcd-f04c-4db2-81ee-81dea4c1dbb5 req-622003ef-8eaa-457c-b615-04e94b871d3e service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Refreshing network info cache for port 48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Start _get_guest_xml network_info=[{"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:57:03 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:57:03 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-761733388',display_name='tempest-VolumesActionsTest-instance-761733388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-761733388',id=28,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fa968e78b2f4b8eac3f96aefa36aa4b',ramdisk_id='',reservation_id='r-16r3ffzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-848179361',owner_user_name='tempest-VolumesActionsTest-848179361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:57:02Z,user_data=None,user_id='fa556ea48af74f00887d740c81841879',uuid=12231bca-69a7-4cc4-a7bf-959d4c818339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converting VIF {"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f4:ec,bridge_name='br-int',has_traffic_filtering=True,id=48919998-7805-43ca-b9dc-11bf1e3015ee,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48919998-78') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lazy-loading 'pci_devices' on Instance uuid 12231bca-69a7-4cc4-a7bf-959d4c818339 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:57:03 user nova-compute[70659]:   <uuid>12231bca-69a7-4cc4-a7bf-959d4c818339</uuid>
Jul 25 16:57:03 user nova-compute[70659]:   <name>instance-0000001c</name>
Jul 25 16:57:03 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:57:03 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:57:03 user nova-compute[70659]:   <metadata>
Jul 25 16:57:03 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:57:03 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:57:03 user nova-compute[70659]:       <nova:name>tempest-VolumesActionsTest-instance-761733388</nova:name>
Jul 25 16:57:03 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:57:03</nova:creationTime>
Jul 25 16:57:03 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:57:03 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:57:03 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:57:03 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:57:03 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:57:03 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:57:03 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:57:03 user nova-compute[70659]:       <nova:owner>
Jul 25 16:57:03 user nova-compute[70659]:         <nova:user uuid="fa556ea48af74f00887d740c81841879">tempest-VolumesActionsTest-848179361-project-member</nova:user>
Jul 25 16:57:03 user nova-compute[70659]:         <nova:project uuid="5fa968e78b2f4b8eac3f96aefa36aa4b">tempest-VolumesActionsTest-848179361</nova:project>
Jul 25 16:57:03 user nova-compute[70659]:       </nova:owner>
Jul 25 16:57:03 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:57:03 user nova-compute[70659]:       <nova:ports>
Jul 25 16:57:03 user nova-compute[70659]:         <nova:port uuid="48919998-7805-43ca-b9dc-11bf1e3015ee">
Jul 25 16:57:03 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 16:57:03 user nova-compute[70659]:         </nova:port>
Jul 25 16:57:03 user nova-compute[70659]:       </nova:ports>
Jul 25 16:57:03 user nova-compute[70659]:     </nova:instance>
Jul 25 16:57:03 user nova-compute[70659]:   </metadata>
Jul 25 16:57:03 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:57:03 user nova-compute[70659]:     <system>
Jul 25 16:57:03 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:57:03 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:57:03 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:57:03 user nova-compute[70659]:       <entry name="serial">12231bca-69a7-4cc4-a7bf-959d4c818339</entry>
Jul 25 16:57:03 user nova-compute[70659]:       <entry name="uuid">12231bca-69a7-4cc4-a7bf-959d4c818339</entry>
Jul 25 16:57:03 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:57:03 user nova-compute[70659]:     </system>
Jul 25 16:57:03 user nova-compute[70659]:   </sysinfo>
Jul 25 16:57:03 user nova-compute[70659]:   <os>
Jul 25 16:57:03 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:57:03 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:57:03 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:57:03 user nova-compute[70659]:   </os>
Jul 25 16:57:03 user nova-compute[70659]:   <features>
Jul 25 16:57:03 user nova-compute[70659]:     <acpi/>
Jul 25 16:57:03 user nova-compute[70659]:     <apic/>
Jul 25 16:57:03 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:57:03 user nova-compute[70659]:   </features>
Jul 25 16:57:03 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:57:03 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:57:03 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:57:03 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:57:03 user nova-compute[70659]:   </clock>
Jul 25 16:57:03 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:57:03 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:57:03 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:57:03 user nova-compute[70659]:   </cpu>
Jul 25 16:57:03 user nova-compute[70659]:   <devices>
Jul 25 16:57:03 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:57:03 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:57:03 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk"/>
Jul 25 16:57:03 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:57:03 user nova-compute[70659]:     </disk>
Jul 25 16:57:03 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:57:03 user nova-compute[70659]:       <mac address="fa:16:3e:f6:f4:ec"/>
Jul 25 16:57:03 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:57:03 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:57:03 user nova-compute[70659]:       <target dev="tap48919998-78"/>
Jul 25 16:57:03 user nova-compute[70659]:     </interface>
Jul 25 16:57:03 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:57:03 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/console.log" append="off"/>
Jul 25 16:57:03 user nova-compute[70659]:     </serial>
Jul 25 16:57:03 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:57:03 user nova-compute[70659]:     <video>
Jul 25 16:57:03 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:57:03 user nova-compute[70659]:     </video>
Jul 25 16:57:03 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:57:03 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:57:03 user nova-compute[70659]:     </rng>
Jul 25 16:57:03 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:57:03 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:57:03 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:57:03 user nova-compute[70659]:     </memballoon>
Jul 25 16:57:03 user nova-compute[70659]:   </devices>
Jul 25 16:57:03 user nova-compute[70659]: </domain>
Jul 25 16:57:03 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-761733388',display_name='tempest-VolumesActionsTest-instance-761733388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-761733388',id=28,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fa968e78b2f4b8eac3f96aefa36aa4b',ramdisk_id='',reservation_id='r-16r3ffzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-848179361',owner_user_name='tempest-VolumesActionsTest-848179361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:57:02Z,user_data=None,user_id='fa556ea48af74f00887d740c81841879',uuid=12231bca-69a7-4cc4-a7bf-959d4c818339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converting VIF {"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f4:ec,bridge_name='br-int',has_traffic_filtering=True,id=48919998-7805-43ca-b9dc-11bf1e3015ee,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48919998-78') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG os_vif [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f4:ec,bridge_name='br-int',has_traffic_filtering=True,id=48919998-7805-43ca-b9dc-11bf1e3015ee,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48919998-78') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48919998-78, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48919998-78, col_values=(('external_ids', {'iface-id': '48919998-7805-43ca-b9dc-11bf1e3015ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:f4:ec', 'vm-uuid': '12231bca-69a7-4cc4-a7bf-959d4c818339'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:57:03 user nova-compute[70659]: INFO os_vif [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f4:ec,bridge_name='br-int',has_traffic_filtering=True,id=48919998-7805-43ca-b9dc-11bf1e3015ee,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48919998-78')
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:57:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] No VIF found with MAC fa:16:3e:f6:f4:ec, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:57:04 user nova-compute[70659]: DEBUG nova.network.neutron [req-cdb40bcd-f04c-4db2-81ee-81dea4c1dbb5 req-622003ef-8eaa-457c-b615-04e94b871d3e service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Updated VIF entry in instance network info cache for port 48919998-7805-43ca-b9dc-11bf1e3015ee. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:57:04 user nova-compute[70659]: DEBUG nova.network.neutron [req-cdb40bcd-f04c-4db2-81ee-81dea4c1dbb5 req-622003ef-8eaa-457c-b615-04e94b871d3e service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Updating instance_info_cache with network_info: [{"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:57:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cdb40bcd-f04c-4db2-81ee-81dea4c1dbb5 req-622003ef-8eaa-457c-b615-04e94b871d3e service nova] Releasing lock "refresh_cache-12231bca-69a7-4cc4-a7bf-959d4c818339" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-edf33a66-0e16-46d9-845f-4edf84c5a91b req-a9507a0c-6964-4274-a4d5-c996a3f87fd3 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received event network-vif-plugged-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-edf33a66-0e16-46d9-845f-4edf84c5a91b req-a9507a0c-6964-4274-a4d5-c996a3f87fd3 service nova] Acquiring lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-edf33a66-0e16-46d9-845f-4edf84c5a91b req-a9507a0c-6964-4274-a4d5-c996a3f87fd3 service nova] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-edf33a66-0e16-46d9-845f-4edf84c5a91b req-a9507a0c-6964-4274-a4d5-c996a3f87fd3 service nova] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-edf33a66-0e16-46d9-845f-4edf84c5a91b req-a9507a0c-6964-4274-a4d5-c996a3f87fd3 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] No waiting events found dispatching network-vif-plugged-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:05 user nova-compute[70659]: WARNING nova.compute.manager [req-edf33a66-0e16-46d9-845f-4edf84c5a91b req-a9507a0c-6964-4274-a4d5-c996a3f87fd3 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received unexpected event network-vif-plugged-48919998-7805-43ca-b9dc-11bf1e3015ee for instance with vm_state building and task_state spawning.
Jul 25 16:57:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304227.1901264, 12231bca-69a7-4cc4-a7bf-959d4c818339 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:57:07 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] VM Resumed (Lifecycle Event)
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:57:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Instance spawned successfully.
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:57:07 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304227.1916964, 12231bca-69a7-4cc4-a7bf-959d4c818339 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:57:07 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] VM Started (Lifecycle Event)
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:57:07 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:57:07 user nova-compute[70659]: INFO nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Took 5.50 seconds to spawn the instance on the hypervisor.
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:07 user nova-compute[70659]: INFO nova.compute.manager [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Took 6.24 seconds to build instance.
Jul 25 16:57:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fbde4f81-e345-4047-9b49-684f9ef0cc17 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.599s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-0f81b427-d1ec-4538-847e-3c12aade2c06 req-c6e4d3b4-7890-46f6-9fcc-b3d8651f7adf service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received event network-vif-plugged-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0f81b427-d1ec-4538-847e-3c12aade2c06 req-c6e4d3b4-7890-46f6-9fcc-b3d8651f7adf service nova] Acquiring lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0f81b427-d1ec-4538-847e-3c12aade2c06 req-c6e4d3b4-7890-46f6-9fcc-b3d8651f7adf service nova] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0f81b427-d1ec-4538-847e-3c12aade2c06 req-c6e4d3b4-7890-46f6-9fcc-b3d8651f7adf service nova] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-0f81b427-d1ec-4538-847e-3c12aade2c06 req-c6e4d3b4-7890-46f6-9fcc-b3d8651f7adf service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] No waiting events found dispatching network-vif-plugged-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:07 user nova-compute[70659]: WARNING nova.compute.manager [req-0f81b427-d1ec-4538-847e-3c12aade2c06 req-c6e4d3b4-7890-46f6-9fcc-b3d8651f7adf service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received unexpected event network-vif-plugged-48919998-7805-43ca-b9dc-11bf1e3015ee for instance with vm_state active and task_state None.
Jul 25 16:57:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:17 user nova-compute[70659]: INFO nova.compute.manager [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Unshelving
Jul 25 16:57:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'pci_requests' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'numa_topology' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:17 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:57:17 user nova-compute[70659]: INFO nova.compute.claims [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Claim successful on node user
Jul 25 16:57:18 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:57:18 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:57:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:18 user nova-compute[70659]: INFO nova.network.neutron [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updating port f4400904-3e5b-4610-af28-f24e8fa7cf20 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 25 16:57:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:57:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:57:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquired lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:57:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:57:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-1f98067e-a15b-46a1-b73b-51cf5e562020 req-4fb2aa72-5c27-4bb8-9a2b-e8bfe09585c6 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-changed-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-1f98067e-a15b-46a1-b73b-51cf5e562020 req-4fb2aa72-5c27-4bb8-9a2b-e8bfe09585c6 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Refreshing instance network info cache due to event network-changed-f4400904-3e5b-4610-af28-f24e8fa7cf20. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:57:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1f98067e-a15b-46a1-b73b-51cf5e562020 req-4fb2aa72-5c27-4bb8-9a2b-e8bfe09585c6 service nova] Acquiring lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG nova.network.neutron [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updating instance_info_cache with network_info: [{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Releasing lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:57:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Creating image(s)
Jul 25 16:57:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG nova.objects.instance [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'trusted_certs' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1f98067e-a15b-46a1-b73b-51cf5e562020 req-4fb2aa72-5c27-4bb8-9a2b-e8bfe09585c6 service nova] Acquired lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-1f98067e-a15b-46a1-b73b-51cf5e562020 req-4fb2aa72-5c27-4bb8-9a2b-e8bfe09585c6 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Refreshing network info cache for port f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "388db3166485eff41ad3152522697a898372fb0d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "388db3166485eff41ad3152522697a898372fb0d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d.part --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:20 user nova-compute[70659]: DEBUG nova.virt.images [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] 1864bb2d-bc87-475a-aaac-10a9d74abd2b was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 16:57:20 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 16:57:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d.part /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-1f98067e-a15b-46a1-b73b-51cf5e562020 req-4fb2aa72-5c27-4bb8-9a2b-e8bfe09585c6 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updated VIF entry in instance network info cache for port f4400904-3e5b-4610-af28-f24e8fa7cf20. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:57:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-1f98067e-a15b-46a1-b73b-51cf5e562020 req-4fb2aa72-5c27-4bb8-9a2b-e8bfe09585c6 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updating instance_info_cache with network_info: [{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:57:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1f98067e-a15b-46a1-b73b-51cf5e562020 req-4fb2aa72-5c27-4bb8-9a2b-e8bfe09585c6 service nova] Releasing lock "refresh_cache-f201428e-c462-4cf2-881c-6712801f2e02" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:57:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d.part /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d.converted" returned: 0 in 1.014s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "388db3166485eff41ad3152522697a898372fb0d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.745s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "388db3166485eff41ad3152522697a898372fb0d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "388db3166485eff41ad3152522697a898372fb0d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d,backing_fmt=raw /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d,backing_fmt=raw /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk 1073741824" returned: 0 in 0.069s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "388db3166485eff41ad3152522697a898372fb0d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG nova.objects.instance [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'migration_context' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:22 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Rebasing disk image.
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 -F raw /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG nova.objects.instance [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:24 user nova-compute[70659]: INFO nova.compute.manager [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attaching volume e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 to /dev/vdb
Jul 25 16:57:24 user nova-compute[70659]: DEBUG os_brick.utils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1173a1-67dc-49e7-b499-9260db906cd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e3005-74bb-4c9b-80bc-b0c6644c2904]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62d62ff-e918-4c01-acc1-17e1edd223e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[65df7806-0b92-45c3-93f4-538a34ff3864]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:57:25 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:57:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7847a36-1532-4880-b89a-ea5b38b11d3d]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG os_brick.utils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:57:25 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updating existing volume attachment record: 45c274ed-ef02-4613-8f74-e9f5e0a20bfd {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 -F raw /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk" returned: 0 in 3.278s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Ensure instance console log exists: /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Start _get_guest_xml network_info=[{"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e0b9d147d6fd5937d197838e98588e02',container_format='bare',created_at=2023-07-25T16:55:25Z,direct_url=<?>,disk_format='qcow2',id=1864bb2d-bc87-475a-aaac-10a9d74abd2b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-815855632-shelved',owner='6b9ac672b01748d191239756a58474c3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T16:55:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:57:26 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:57:26 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e0b9d147d6fd5937d197838e98588e02',container_format='bare',created_at=2023-07-25T16:55:25Z,direct_url=<?>,disk_format='qcow2',id=1864bb2d-bc87-475a-aaac-10a9d74abd2b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-815855632-shelved',owner='6b9ac672b01748d191239756a58474c3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T16:55:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.objects.instance [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'vcpu_model' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-815855632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-815855632',id=20,image_ref='1864bb2d-bc87-475a-aaac-10a9d74abd2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-584068859',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:53:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-3bjpe9kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member',shelved_at='2023-07-25T16:55:29.535767',shelved_host='user',shelved_image_id='1864bb2d-bc87-475a-aaac-10a9d74abd2b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=f201428e-c462-4cf2-881c-6712801f2e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.objects.instance [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'pci_devices' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:57:26 user nova-compute[70659]:   <uuid>f201428e-c462-4cf2-881c-6712801f2e02</uuid>
Jul 25 16:57:26 user nova-compute[70659]:   <name>instance-00000014</name>
Jul 25 16:57:26 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:57:26 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:57:26 user nova-compute[70659]:   <metadata>
Jul 25 16:57:26 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:57:26 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:57:26 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-815855632</nova:name>
Jul 25 16:57:26 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:57:26</nova:creationTime>
Jul 25 16:57:26 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:57:26 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:57:26 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:57:26 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:57:26 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:57:26 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:57:26 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:57:26 user nova-compute[70659]:       <nova:owner>
Jul 25 16:57:26 user nova-compute[70659]:         <nova:user uuid="bd26fb262d7b47638bb0a0df0ea10c24">tempest-AttachVolumeShelveTestJSON-569325814-project-member</nova:user>
Jul 25 16:57:26 user nova-compute[70659]:         <nova:project uuid="6b9ac672b01748d191239756a58474c3">tempest-AttachVolumeShelveTestJSON-569325814</nova:project>
Jul 25 16:57:26 user nova-compute[70659]:       </nova:owner>
Jul 25 16:57:26 user nova-compute[70659]:       <nova:root type="image" uuid="1864bb2d-bc87-475a-aaac-10a9d74abd2b"/>
Jul 25 16:57:26 user nova-compute[70659]:       <nova:ports>
Jul 25 16:57:26 user nova-compute[70659]:         <nova:port uuid="f4400904-3e5b-4610-af28-f24e8fa7cf20">
Jul 25 16:57:26 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 16:57:26 user nova-compute[70659]:         </nova:port>
Jul 25 16:57:26 user nova-compute[70659]:       </nova:ports>
Jul 25 16:57:26 user nova-compute[70659]:     </nova:instance>
Jul 25 16:57:26 user nova-compute[70659]:   </metadata>
Jul 25 16:57:26 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:57:26 user nova-compute[70659]:     <system>
Jul 25 16:57:26 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:57:26 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:57:26 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:57:26 user nova-compute[70659]:       <entry name="serial">f201428e-c462-4cf2-881c-6712801f2e02</entry>
Jul 25 16:57:26 user nova-compute[70659]:       <entry name="uuid">f201428e-c462-4cf2-881c-6712801f2e02</entry>
Jul 25 16:57:26 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:57:26 user nova-compute[70659]:     </system>
Jul 25 16:57:26 user nova-compute[70659]:   </sysinfo>
Jul 25 16:57:26 user nova-compute[70659]:   <os>
Jul 25 16:57:26 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:57:26 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:57:26 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:57:26 user nova-compute[70659]:   </os>
Jul 25 16:57:26 user nova-compute[70659]:   <features>
Jul 25 16:57:26 user nova-compute[70659]:     <acpi/>
Jul 25 16:57:26 user nova-compute[70659]:     <apic/>
Jul 25 16:57:26 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:57:26 user nova-compute[70659]:   </features>
Jul 25 16:57:26 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:57:26 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:57:26 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:57:26 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:57:26 user nova-compute[70659]:   </clock>
Jul 25 16:57:26 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:57:26 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:57:26 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:57:26 user nova-compute[70659]:   </cpu>
Jul 25 16:57:26 user nova-compute[70659]:   <devices>
Jul 25 16:57:26 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:57:26 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:57:26 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk"/>
Jul 25 16:57:26 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:57:26 user nova-compute[70659]:     </disk>
Jul 25 16:57:26 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:57:26 user nova-compute[70659]:       <mac address="fa:16:3e:08:86:68"/>
Jul 25 16:57:26 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:57:26 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:57:26 user nova-compute[70659]:       <target dev="tapf4400904-3e"/>
Jul 25 16:57:26 user nova-compute[70659]:     </interface>
Jul 25 16:57:26 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:57:26 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/console.log" append="off"/>
Jul 25 16:57:26 user nova-compute[70659]:     </serial>
Jul 25 16:57:26 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:57:26 user nova-compute[70659]:     <video>
Jul 25 16:57:26 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:57:26 user nova-compute[70659]:     </video>
Jul 25 16:57:26 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:57:26 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:57:26 user nova-compute[70659]:     </rng>
Jul 25 16:57:26 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:57:26 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:57:26 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:57:26 user nova-compute[70659]:     </memballoon>
Jul 25 16:57:26 user nova-compute[70659]:   </devices>
Jul 25 16:57:26 user nova-compute[70659]: </domain>
Jul 25 16:57:26 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-815855632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-815855632',id=20,image_ref='1864bb2d-bc87-475a-aaac-10a9d74abd2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-584068859',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:53:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-3bjpe9kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member',shelved_at='2023-07-25T16:55:29.535767',shelved_host='user',shelved_image_id='1864bb2d-bc87-475a-aaac-10a9d74abd2b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=f201428e-c462-4cf2-881c-6712801f2e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG os_vif [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4400904-3e, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4400904-3e, col_values=(('external_ids', {'iface-id': 'f4400904-3e5b-4610-af28-f24e8fa7cf20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:86:68', 'vm-uuid': 'f201428e-c462-4cf2-881c-6712801f2e02'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:26 user nova-compute[70659]: INFO os_vif [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e')
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] No VIF found with MAC fa:16:3e:08:86:68, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:57:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-5844e625-4f50-4d3a-80b5-613621eca8bb req-06dc587d-ee8e-418b-8c4c-7dbdf9ba0624 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5844e625-4f50-4d3a-80b5-613621eca8bb req-06dc587d-ee8e-418b-8c4c-7dbdf9ba0624 service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5844e625-4f50-4d3a-80b5-613621eca8bb req-06dc587d-ee8e-418b-8c4c-7dbdf9ba0624 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5844e625-4f50-4d3a-80b5-613621eca8bb req-06dc587d-ee8e-418b-8c4c-7dbdf9ba0624 service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-5844e625-4f50-4d3a-80b5-613621eca8bb req-06dc587d-ee8e-418b-8c4c-7dbdf9ba0624 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:28 user nova-compute[70659]: WARNING nova.compute.manager [req-5844e625-4f50-4d3a-80b5-613621eca8bb req-06dc587d-ee8e-418b-8c4c-7dbdf9ba0624 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 16:57:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-2aef4cc0-4cac-4a9e-bdff-39cc3392ccb5 req-86dda030-011c-4385-8651-668d53716c0a service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2aef4cc0-4cac-4a9e-bdff-39cc3392ccb5 req-86dda030-011c-4385-8651-668d53716c0a service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2aef4cc0-4cac-4a9e-bdff-39cc3392ccb5 req-86dda030-011c-4385-8651-668d53716c0a service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2aef4cc0-4cac-4a9e-bdff-39cc3392ccb5 req-86dda030-011c-4385-8651-668d53716c0a service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-2aef4cc0-4cac-4a9e-bdff-39cc3392ccb5 req-86dda030-011c-4385-8651-668d53716c0a service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:30 user nova-compute[70659]: WARNING nova.compute.manager [req-2aef4cc0-4cac-4a9e-bdff-39cc3392ccb5 req-86dda030-011c-4385-8651-668d53716c0a service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304250.5584886, f201428e-c462-4cf2-881c-6712801f2e02 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:57:30 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] VM Resumed (Lifecycle Event)
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:57:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance spawned successfully.
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:57:30 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304250.5602767, f201428e-c462-4cf2-881c-6712801f2e02 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:57:30 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] VM Started (Lifecycle Event)
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:57:30 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:57:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-156ff1d5-58f2-4bed-9b28-71fd4e44874e tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.295s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHmwkjfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:57:32 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:57:32 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:57:32 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e83b34-1dec-401d-98fb-e971c545510e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:57:32 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[db138155-d2f8-4aa6-b9a8-5258b07ec41a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99] added
Jul 25 16:57:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab53a9c-0f01-453c-b0a3-12dd0b359693]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[69365fda-b59d-4f8b-a5d9-7a10355fcf2a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHmwkjfZ {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHmwkjfZ" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba228f6-d7b1-45ec-8613-666bca77b05b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VHmwkjfZ'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8141ce6c-a6af-4bd5-94d5-b274a9eb6e43]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ececa2-655c-40f8-b96f-7109e4fe7637]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0092bf-2fc9-4af8-8854-a0a4dd39ac43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99, portal: 172.16.0.220,3260]
Jul 25 16:57:32 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99, portal: 172.16.0.220,3260] successful.
Jul 25 16:57:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.191s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf90c0c-aba3-4cf8-9dbd-96e59cabc816]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2799c2e7-cf53-4a24-9480-7993201c03cb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 (non-flash)
Jul 25 16:57:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.487s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb3a48f-ab9c-45af-a422-df9646480a97]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:57:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHmwkjfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:57:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:57:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== connect_volume: return (1522ms) {'type': 'block', 'scsi_wwn': '26632356334353864', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:57:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632356334353864', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:57:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:57:33 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:57:33 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:57:33 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:57:33 user nova-compute[70659]:   <serial>e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99</serial>
Jul 25 16:57:33 user nova-compute[70659]: </disk>
Jul 25 16:57:33 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:57:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:57:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:57:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No VIF found with MAC fa:16:3e:56:91:c8, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:57:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-86fd30ec-af87-4c9f-a207-aac2a30f612b tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.628s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:36 user nova-compute[70659]: INFO nova.compute.manager [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Detaching volume e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99
Jul 25 16:57:36 user nova-compute[70659]: INFO nova.virt.block_device [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attempting to driver detach volume e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 from mountpoint /dev/vdb
Jul 25 16:57:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Attempting to detach device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:57:36 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:57:36 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:57:36 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:57:36 user nova-compute[70659]:   <serial>e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99</serial>
Jul 25 16:57:36 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:57:36 user nova-compute[70659]: </disk>
Jul 25 16:57:36 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:57:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully detached device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the persistent domain config.
Jul 25 16:57:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:57:36 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:57:36 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:57:36 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:57:36 user nova-compute[70659]:   <serial>e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99</serial>
Jul 25 16:57:36 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:57:36 user nova-compute[70659]: </disk>
Jul 25 16:57:36 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:36 user nova-compute[70659]: INFO nova.compute.manager [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Terminating instance
Jul 25 16:57:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304256.8925138, f6fba6f6-ff72-43c2-b824-f262bf430eac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:57:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully detached device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the live domain config.
Jul 25 16:57:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHmwkjfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:57:36 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:57:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a27aaa0-cef6-4aab-b6ba-bf62a693e674]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8436554c-4671-479d-8014-5c4523a985fb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:36 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:36 user nova-compute[70659]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 (non-flash)
Jul 25 16:57:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:36 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:36 user nova-compute[70659]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 (non-flash)
Jul 25 16:57:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd28282290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:57:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8da43f-1350-4448-b819-c3e93015c59f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab744f9-fd66-4bbd-8c0a-6cb87a237216]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5c4e65-05a6-462e-90b7-a0b15ed7269f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0554b86b-d811-44bc-bcfe-e89a0b8317db]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4309c-4886-46ab-8495-79384061941a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-248c4541-cc4e-4664-ba3f-6342c4af21bd req-6cb75334-4c2d-4446-85be-4fb5ebaa2d0d service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received event network-vif-unplugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-248c4541-cc4e-4664-ba3f-6342c4af21bd req-6cb75334-4c2d-4446-85be-4fb5ebaa2d0d service nova] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-248c4541-cc4e-4664-ba3f-6342c4af21bd req-6cb75334-4c2d-4446-85be-4fb5ebaa2d0d service nova] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-248c4541-cc4e-4664-ba3f-6342c4af21bd req-6cb75334-4c2d-4446-85be-4fb5ebaa2d0d service nova] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-248c4541-cc4e-4664-ba3f-6342c4af21bd req-6cb75334-4c2d-4446-85be-4fb5ebaa2d0d service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] No waiting events found dispatching network-vif-unplugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-248c4541-cc4e-4664-ba3f-6342c4af21bd req-6cb75334-4c2d-4446-85be-4fb5ebaa2d0d service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received event network-vif-unplugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41d5160-7b08-43d8-a25a-dfc72e835e15]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99, portal: 172.16.0.220,3260]
Jul 25 16:57:37 user nova-compute[70659]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99, portal: 172.16.0.220,3260] successful.
Jul 25 16:57:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d99fb1-58ca-45a8-b4cb-c0e4e9f72f99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7673bc-d45e-4079-a09f-325fd620692e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== disconnect_volume: return (363ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:57:37 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Instance destroyed successfully.
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.objects.instance [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lazy-loading 'resources' on Instance uuid 743875b3-2013-4162-9940-f1f59ca6c7f6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-737422303',display_name='tempest-VolumesAdminNegativeTest-server-737422303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-737422303',id=16,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JYbWy8Y4uHct5MJ17ozOyQ/QzQF+XwqIfdBVDpuqw4ogKbeHe0ry5s6dn2hBwBTLu/jUP+f7dDZs0MhKkhQz0WT61NnJv65eBjqTyliYs1+AQtBL7UhPr0zGLcgim3g==',key_name='tempest-keypair-37147808',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:51:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1548931d431b4da4859656f41b33a88c',ramdisk_id='',reservation_id='r-z6c2rval',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-863505829',owner_user_name='tempest-VolumesAdminNegativeTest-863505829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a55ce1dcf3eb4f7da9ce20dbc7e432c0',uuid=743875b3-2013-4162-9940-f1f59ca6c7f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converting VIF {"id": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "address": "fa:16:3e:4e:25:b1", "network": {"id": "7638cae0-d737-48be-8102-9c49d19947df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1569725649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1548931d431b4da4859656f41b33a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a3b00a-b9", "ovs_interfaceid": "02a3b00a-b9f6-4472-9186-c7db2e916cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:25:b1,bridge_name='br-int',has_traffic_filtering=True,id=02a3b00a-b9f6-4472-9186-c7db2e916cb9,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a3b00a-b9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG os_vif [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:25:b1,bridge_name='br-int',has_traffic_filtering=True,id=02a3b00a-b9f6-4472-9186-c7db2e916cb9,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a3b00a-b9') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02a3b00a-b9, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:57:37 user nova-compute[70659]: INFO os_vif [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:25:b1,bridge_name='br-int',has_traffic_filtering=True,id=02a3b00a-b9f6-4472-9186-c7db2e916cb9,network=Network(7638cae0-d737-48be-8102-9c49d19947df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a3b00a-b9')
Jul 25 16:57:37 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Deleting instance files /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6_del
Jul 25 16:57:37 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Deletion of /opt/stack/data/nova/instances/743875b3-2013-4162-9940-f1f59ca6c7f6_del complete
Jul 25 16:57:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:37 user nova-compute[70659]: INFO nova.compute.manager [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 25 16:57:37 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:57:37 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:57:38 user nova-compute[70659]: DEBUG nova.objects.instance [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-55fa300f-1940-4824-aca7-8bb45f790e98 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.947s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:38 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:57:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-451d7a27-5cd1-4e08-be9e-060790fe56ff req-1a958355-19eb-4d72-bd9d-7aff7476e0bd service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received event network-vif-deleted-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:38 user nova-compute[70659]: INFO nova.compute.manager [req-451d7a27-5cd1-4e08-be9e-060790fe56ff req-1a958355-19eb-4d72-bd9d-7aff7476e0bd service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Neutron deleted interface 02a3b00a-b9f6-4472-9186-c7db2e916cb9; detaching it from the instance and deleting it from the info cache
Jul 25 16:57:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-451d7a27-5cd1-4e08-be9e-060790fe56ff req-1a958355-19eb-4d72-bd9d-7aff7476e0bd service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:57:38 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Took 1.40 seconds to deallocate network for instance.
Jul 25 16:57:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-451d7a27-5cd1-4e08-be9e-060790fe56ff req-1a958355-19eb-4d72-bd9d-7aff7476e0bd service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Detach interface failed, port_id=02a3b00a-b9f6-4472-9186-c7db2e916cb9, reason: Instance 743875b3-2013-4162-9940-f1f59ca6c7f6 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-be1f2fde-e578-45f2-ba83-32e7dcd7a3fd req-fc376365-3d91-4b16-a69b-fd8eff39e29f service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received event network-vif-plugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be1f2fde-e578-45f2-ba83-32e7dcd7a3fd req-fc376365-3d91-4b16-a69b-fd8eff39e29f service nova] Acquiring lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be1f2fde-e578-45f2-ba83-32e7dcd7a3fd req-fc376365-3d91-4b16-a69b-fd8eff39e29f service nova] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-be1f2fde-e578-45f2-ba83-32e7dcd7a3fd req-fc376365-3d91-4b16-a69b-fd8eff39e29f service nova] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-be1f2fde-e578-45f2-ba83-32e7dcd7a3fd req-fc376365-3d91-4b16-a69b-fd8eff39e29f service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] No waiting events found dispatching network-vif-plugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:39 user nova-compute[70659]: WARNING nova.compute.manager [req-be1f2fde-e578-45f2-ba83-32e7dcd7a3fd req-fc376365-3d91-4b16-a69b-fd8eff39e29f service nova] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Received unexpected event network-vif-plugged-02a3b00a-b9f6-4472-9186-c7db2e916cb9 for instance with vm_state deleted and task_state None.
Jul 25 16:57:39 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:57:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.639s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:39 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Deleted allocations for instance 743875b3-2013-4162-9940-f1f59ca6c7f6
Jul 25 16:57:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-420a3b76-094b-4b7d-8d8f-8cbd55dd504b tempest-VolumesAdminNegativeTest-863505829 tempest-VolumesAdminNegativeTest-863505829-project-member] Lock "743875b3-2013-4162-9940-f1f59ca6c7f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.124s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:45 user nova-compute[70659]: INFO nova.compute.manager [None req-52138464-5996-4cd0-bd09-74092777fb2c tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Unrescuing
Jul 25 16:57:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-52138464-5996-4cd0-bd09-74092777fb2c tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:57:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-52138464-5996-4cd0-bd09-74092777fb2c tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquired lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:57:45 user nova-compute[70659]: DEBUG nova.network.neutron [None req-52138464-5996-4cd0-bd09-74092777fb2c tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:57:45 user nova-compute[70659]: DEBUG nova.network.neutron [None req-52138464-5996-4cd0-bd09-74092777fb2c tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updating instance_info_cache with network_info: [{"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:57:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-52138464-5996-4cd0-bd09-74092777fb2c tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Releasing lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:57:45 user nova-compute[70659]: DEBUG nova.objects.instance [None req-52138464-5996-4cd0-bd09-74092777fb2c tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'flavor' on Instance uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-ee09d810-49ad-4203-b07e-5bf7a7c3fa6b req-c90a891d-5f7b-4b4a-b340-71c429f4910e service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-unplugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ee09d810-49ad-4203-b07e-5bf7a7c3fa6b req-c90a891d-5f7b-4b4a-b340-71c429f4910e service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ee09d810-49ad-4203-b07e-5bf7a7c3fa6b req-c90a891d-5f7b-4b4a-b340-71c429f4910e service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ee09d810-49ad-4203-b07e-5bf7a7c3fa6b req-c90a891d-5f7b-4b4a-b340-71c429f4910e service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-ee09d810-49ad-4203-b07e-5bf7a7c3fa6b req-c90a891d-5f7b-4b4a-b340-71c429f4910e service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-unplugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:46 user nova-compute[70659]: WARNING nova.compute.manager [req-ee09d810-49ad-4203-b07e-5bf7a7c3fa6b req-c90a891d-5f7b-4b4a-b340-71c429f4910e service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-unplugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:57:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] Instance destroyed successfully.
Jul 25 16:57:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-475e47ef-3932-4b76-98bd-21a624edf0c9 req-df82246d-dbef-41de-a739-d3d22ed2181f service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-475e47ef-3932-4b76-98bd-21a624edf0c9 req-df82246d-dbef-41de-a739-d3d22ed2181f service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-475e47ef-3932-4b76-98bd-21a624edf0c9 req-df82246d-dbef-41de-a739-d3d22ed2181f service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-475e47ef-3932-4b76-98bd-21a624edf0c9 req-df82246d-dbef-41de-a739-d3d22ed2181f service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-475e47ef-3932-4b76-98bd-21a624edf0c9 req-df82246d-dbef-41de-a739-d3d22ed2181f service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:48 user nova-compute[70659]: WARNING nova.compute.manager [req-475e47ef-3932-4b76-98bd-21a624edf0c9 req-df82246d-dbef-41de-a739-d3d22ed2181f service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:57:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-b73325fd-8e59-4220-a12a-7c2d00b5a142 req-37385f6a-c324-4549-ba49-00f4e0bd07cc service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received event network-changed-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-b73325fd-8e59-4220-a12a-7c2d00b5a142 req-37385f6a-c324-4549-ba49-00f4e0bd07cc service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Refreshing instance network info cache due to event network-changed-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b73325fd-8e59-4220-a12a-7c2d00b5a142 req-37385f6a-c324-4549-ba49-00f4e0bd07cc service nova] Acquiring lock "refresh_cache-f8fe25a3-fe0b-40a6-ad75-cdef0924154d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b73325fd-8e59-4220-a12a-7c2d00b5a142 req-37385f6a-c324-4549-ba49-00f4e0bd07cc service nova] Acquired lock "refresh_cache-f8fe25a3-fe0b-40a6-ad75-cdef0924154d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:57:48 user nova-compute[70659]: DEBUG nova.network.neutron [req-b73325fd-8e59-4220-a12a-7c2d00b5a142 req-37385f6a-c324-4549-ba49-00f4e0bd07cc service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Refreshing network info cache for port 5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'flavor' on Instance uuid f8fe25a3-fe0b-40a6-ad75-cdef0924154d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:49 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Ignoring supplied device name: /dev/vdb
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:49 user nova-compute[70659]: INFO nova.compute.manager [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Attaching volume b02586eb-394e-4ca6-b5e6-00955b69b92c to /dev/vdb
Jul 25 16:57:49 user nova-compute[70659]: DEBUG os_brick.utils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG nova.network.neutron [req-b73325fd-8e59-4220-a12a-7c2d00b5a142 req-37385f6a-c324-4549-ba49-00f4e0bd07cc service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Updated VIF entry in instance network info cache for port 5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG nova.network.neutron [req-b73325fd-8e59-4220-a12a-7c2d00b5a142 req-37385f6a-c324-4549-ba49-00f4e0bd07cc service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Updating instance_info_cache with network_info: [{"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b73325fd-8e59-4220-a12a-7c2d00b5a142 req-37385f6a-c324-4549-ba49-00f4e0bd07cc service nova] Releasing lock "refresh_cache-f8fe25a3-fe0b-40a6-ad75-cdef0924154d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe31dccc-30db-4be3-acc0-780674295dc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eba8dd-580c-4c99-996e-c99ea07124c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.114s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c990434-db4c-477a-b2b3-7ce99b9202e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a23267-2bba-487d-be5d-d52ff0e3f0aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:57:49 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:57:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[793ffd1a-d3eb-4a1e-a96c-75a47cd5af6f]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG os_brick.utils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] <== get_connector_properties: return (227ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:57:49 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Updating existing volume attachment record: 7a9c0a7f-103a-4c6f-bc5e-f71dd9b1d241 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for 73980900-2093-4338-8460-d91df2e2709d due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304270.23623, 73980900-2093-4338-8460-d91df2e2709d => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:57:50 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] VM Resumed (Lifecycle Event)
Jul 25 16:57:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-52138464-5996-4cd0-bd09-74092777fb2c tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:57:50 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304270.2436843, 73980900-2093-4338-8460-d91df2e2709d => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:57:50 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] VM Started (Lifecycle Event)
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:50 user nova-compute[70659]: WARNING nova.compute.manager [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state active and task_state None.
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:57:50 user nova-compute[70659]: WARNING nova.compute.manager [req-c0665268-c368-4806-af7b-22185e927e71 req-4a27dd28-d658-475e-8b28-8dc7f196d02a service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state active and task_state None.
Jul 25 16:57:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304257.4499507, 743875b3-2013-4162-9940-f1f59ca6c7f6 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:57:52 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] VM Stopped (Lifecycle Event)
Jul 25 16:57:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f065c27c-eef4-42ed-845b-d523d03d682d None None] [instance: 743875b3-2013-4162-9940-f1f59ca6c7f6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RECiuPoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:57:56 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:57:56 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:57:56 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:57:56 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=6948MB free_disk=25.176925659179688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d134130-a0a3-4f0f-838d-b655a0a78a03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:57:56 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3522d06-6964-48ff-b5b7-7d6194b50986]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c] added
Jul 25 16:57:56 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3535f0b4-9960-47a4-9be8-d5907864d423]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7048583-2116-4d7b-8952-fbd4c2ec57f8]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RECiuPoA {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RECiuPoA" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d69e932-6e4d-487a-aba4-99ee1a37fd80]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RECiuPoA'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f6fba6f6-ff72-43c2-b824-f262bf430eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 51c336bc-e646-4429-809d-354ae03bd8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f8fe25a3-fe0b-40a6-ad75-cdef0924154d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0abf1dbe-c66a-40f1-9901-dc71a3c95850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 4d852fe8-32e2-447d-8e78-f7093db56d6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 12231bca-69a7-4cc4-a7bf-959d4c818339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f201428e-c462-4cf2-881c-6712801f2e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[461f6f4a-6a54-41a2-b635-4f513a527bfb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbced46-8f93-40f0-bc1a-b1cb7f2236ff]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:56 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:56 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:56 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:56 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5658114-5794-40aa-8f5d-6fc9c6a0e2b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c, portal: 172.16.0.220,3260]
Jul 25 16:57:56 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c, portal: 172.16.0.220,3260] successful.
Jul 25 16:57:56 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81610fd-46e4-454d-9b19-3a4bbb835cbb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:57:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f2fe2-0acf-42eb-87c0-6f02fba204f7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:57 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:57 user nova-compute[70659]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c (non-flash)
Jul 25 16:57:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:57:57 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:57:57 user nova-compute[70659]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c (non-flash)
Jul 25 16:57:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8644df0-aac3-40ca-9a73-79ababdbd419]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RECiuPoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:57:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:57:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23539636633323934', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:57:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539636633323934', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:57:58 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'flavor' on Instance uuid f8fe25a3-fe0b-40a6-ad75-cdef0924154d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:57:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:57:58 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:57:58 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:57:58 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:57:58 user nova-compute[70659]:   <serial>b02586eb-394e-4ca6-b5e6-00955b69b92c</serial>
Jul 25 16:57:58 user nova-compute[70659]: </disk>
Jul 25 16:57:58 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:57:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:57:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:57:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No VIF found with MAC fa:16:3e:cc:e0:f1, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:57:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fdb38238-ae00-4479-95b3-9d23a70bbf78 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.339s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-f3dc2e56-b192-4e05-bb09-468d85f9cf75" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-f3dc2e56-b192-4e05-bb09-468d85f9cf75" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Updating instance_info_cache with network_info: [{"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-f3dc2e56-b192-4e05-bb09-468d85f9cf75" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:57:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:58:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquiring lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquiring lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:09 user nova-compute[70659]: INFO nova.compute.manager [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Terminating instance
Jul 25 16:58:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd96c996-7576-4b98-87f5-55ad6659a48c req-9fbe58a3-aff2-4a70-9d1c-2cf28dc31a5e service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received event network-vif-unplugged-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd96c996-7576-4b98-87f5-55ad6659a48c req-9fbe58a3-aff2-4a70-9d1c-2cf28dc31a5e service nova] Acquiring lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd96c996-7576-4b98-87f5-55ad6659a48c req-9fbe58a3-aff2-4a70-9d1c-2cf28dc31a5e service nova] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd96c996-7576-4b98-87f5-55ad6659a48c req-9fbe58a3-aff2-4a70-9d1c-2cf28dc31a5e service nova] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd96c996-7576-4b98-87f5-55ad6659a48c req-9fbe58a3-aff2-4a70-9d1c-2cf28dc31a5e service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] No waiting events found dispatching network-vif-unplugged-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd96c996-7576-4b98-87f5-55ad6659a48c req-9fbe58a3-aff2-4a70-9d1c-2cf28dc31a5e service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received event network-vif-unplugged-fa736349-3467-47f3-ab7e-47fdc6d191db for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:58:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Instance destroyed successfully.
Jul 25 16:58:10 user nova-compute[70659]: DEBUG nova.objects.instance [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lazy-loading 'resources' on Instance uuid 0abf1dbe-c66a-40f1-9901-dc71a3c95850 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:56:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2078469968',display_name='tempest-VolumesActionsTest-instance-2078469968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2078469968',id=26,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3821de4688c640ea85dcb7dd783865d3',ramdisk_id='',reservation_id='r-zhms2cz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-715820911',owner_user_name='tempest-VolumesActionsTest-715820911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:56:18Z,user_data=None,user_id='1c5ec2c97b3d4b088d72015e814aa6a8',uuid=0abf1dbe-c66a-40f1-9901-dc71a3c95850,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Converting VIF {"id": "fa736349-3467-47f3-ab7e-47fdc6d191db", "address": "fa:16:3e:32:66:32", "network": {"id": "3b012e26-74d5-4ea3-81b5-ac95e4854c7e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067387105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3821de4688c640ea85dcb7dd783865d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa736349-34", "ovs_interfaceid": "fa736349-3467-47f3-ab7e-47fdc6d191db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:66:32,bridge_name='br-int',has_traffic_filtering=True,id=fa736349-3467-47f3-ab7e-47fdc6d191db,network=Network(3b012e26-74d5-4ea3-81b5-ac95e4854c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa736349-34') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG os_vif [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:66:32,bridge_name='br-int',has_traffic_filtering=True,id=fa736349-3467-47f3-ab7e-47fdc6d191db,network=Network(3b012e26-74d5-4ea3-81b5-ac95e4854c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa736349-34') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa736349-34, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:58:10 user nova-compute[70659]: INFO os_vif [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:66:32,bridge_name='br-int',has_traffic_filtering=True,id=fa736349-3467-47f3-ab7e-47fdc6d191db,network=Network(3b012e26-74d5-4ea3-81b5-ac95e4854c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa736349-34')
Jul 25 16:58:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Deleting instance files /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850_del
Jul 25 16:58:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Deletion of /opt/stack/data/nova/instances/0abf1dbe-c66a-40f1-9901-dc71a3c95850_del complete
Jul 25 16:58:10 user nova-compute[70659]: INFO nova.compute.manager [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 25 16:58:10 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:58:10 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Took 0.55 seconds to deallocate network for instance.
Jul 25 16:58:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-062848c9-2ce6-46dc-bf24-9b163b235a95 req-db8290eb-e7ec-41d8-92af-c25fde3d78a8 service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received event network-vif-deleted-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:11 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:58:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:58:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:11 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Deleted allocations for instance 0abf1dbe-c66a-40f1-9901-dc71a3c95850
Jul 25 16:58:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-13c44e25-21b1-414d-a82d-605579ec9022 tempest-VolumesActionsTest-715820911 tempest-VolumesActionsTest-715820911-project-member] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.765s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-d49e2e6d-2f47-48c8-897d-31090fed702e req-2e80523a-f430-4879-9ee6-4184bedaeb3d service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received event network-vif-plugged-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d49e2e6d-2f47-48c8-897d-31090fed702e req-2e80523a-f430-4879-9ee6-4184bedaeb3d service nova] Acquiring lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d49e2e6d-2f47-48c8-897d-31090fed702e req-2e80523a-f430-4879-9ee6-4184bedaeb3d service nova] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d49e2e6d-2f47-48c8-897d-31090fed702e req-2e80523a-f430-4879-9ee6-4184bedaeb3d service nova] Lock "0abf1dbe-c66a-40f1-9901-dc71a3c95850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-d49e2e6d-2f47-48c8-897d-31090fed702e req-2e80523a-f430-4879-9ee6-4184bedaeb3d service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] No waiting events found dispatching network-vif-plugged-fa736349-3467-47f3-ab7e-47fdc6d191db {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:11 user nova-compute[70659]: WARNING nova.compute.manager [req-d49e2e6d-2f47-48c8-897d-31090fed702e req-2e80523a-f430-4879-9ee6-4184bedaeb3d service nova] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Received unexpected event network-vif-plugged-fa736349-3467-47f3-ab7e-47fdc6d191db for instance with vm_state deleted and task_state None.
Jul 25 16:58:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:21 user nova-compute[70659]: INFO nova.compute.manager [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Detaching volume b02586eb-394e-4ca6-b5e6-00955b69b92c
Jul 25 16:58:21 user nova-compute[70659]: INFO nova.virt.block_device [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Attempting to driver detach volume b02586eb-394e-4ca6-b5e6-00955b69b92c from mountpoint /dev/vdb
Jul 25 16:58:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Attempting to detach device vdb from instance f8fe25a3-fe0b-40a6-ad75-cdef0924154d from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:58:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:58:21 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:21 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:58:21 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:58:21 user nova-compute[70659]:   <serial>b02586eb-394e-4ca6-b5e6-00955b69b92c</serial>
Jul 25 16:58:21 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:58:21 user nova-compute[70659]: </disk>
Jul 25 16:58:21 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:58:21 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Successfully detached device vdb from instance f8fe25a3-fe0b-40a6-ad75-cdef0924154d from the persistent domain config.
Jul 25 16:58:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8fe25a3-fe0b-40a6-ad75-cdef0924154d from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:58:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:58:21 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:21 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:58:21 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:58:21 user nova-compute[70659]:   <serial>b02586eb-394e-4ca6-b5e6-00955b69b92c</serial>
Jul 25 16:58:21 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:58:21 user nova-compute[70659]: </disk>
Jul 25 16:58:21 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:58:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304302.1649752, f8fe25a3-fe0b-40a6-ad75-cdef0924154d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8fe25a3-fe0b-40a6-ad75-cdef0924154d {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:58:22 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Successfully detached device vdb from instance f8fe25a3-fe0b-40a6-ad75-cdef0924154d from the live domain config.
Jul 25 16:58:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RECiuPoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:22 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e63925c-3c69-41e9-943d-76e4d2af5799]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8cadf0-e71c-4083-9b0a-123cadebb4d5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:22 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:22 user nova-compute[70659]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c (non-flash)
Jul 25 16:58:22 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:22 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:22 user nova-compute[70659]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c (non-flash)
Jul 25 16:58:22 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd28281fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c8daf9-0ebe-4cf3-a7b7-dc04e6c6c68d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7432af4e-f883-4639-a3ce-8706d2183061]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f521946-ef2d-4460-9004-1efa2ab3c51b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e4b5b5-5635-4910-9b70-ed1f892d77b7]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[740ab80a-8613-47a9-9ab5-049edfb8596c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[362cff81-6114-431e-9ab7-20bcc85b1507]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c, portal: 172.16.0.220,3260]
Jul 25 16:58:22 user nova-compute[70659]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c, portal: 172.16.0.220,3260] successful.
Jul 25 16:58:22 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[12832574-ead7-4847-8f62-a493a9c4767c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] <== disconnect_volume: return (305ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:58:23 user nova-compute[70659]: INFO nova.compute.manager [None req-a750661f-4ea0-4960-9013-c79375b4194e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Unrescuing
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a750661f-4ea0-4960-9013-c79375b4194e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a750661f-4ea0-4960-9013-c79375b4194e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquired lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-a750661f-4ea0-4960-9013-c79375b4194e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'flavor' on Instance uuid f8fe25a3-fe0b-40a6-ad75-cdef0924154d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2ca0d619-a132-4262-a625-1dc99cb38c5f tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.551s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:23 user nova-compute[70659]: INFO nova.compute.manager [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Terminating instance
Jul 25 16:58:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-f5575ed5-e29e-4000-83ef-0df9b03b265a req-5aa0fcb8-1641-4fa8-ab78-26d0076a67cd service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received event network-vif-unplugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f5575ed5-e29e-4000-83ef-0df9b03b265a req-5aa0fcb8-1641-4fa8-ab78-26d0076a67cd service nova] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f5575ed5-e29e-4000-83ef-0df9b03b265a req-5aa0fcb8-1641-4fa8-ab78-26d0076a67cd service nova] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f5575ed5-e29e-4000-83ef-0df9b03b265a req-5aa0fcb8-1641-4fa8-ab78-26d0076a67cd service nova] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-f5575ed5-e29e-4000-83ef-0df9b03b265a req-5aa0fcb8-1641-4fa8-ab78-26d0076a67cd service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] No waiting events found dispatching network-vif-unplugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-f5575ed5-e29e-4000-83ef-0df9b03b265a req-5aa0fcb8-1641-4fa8-ab78-26d0076a67cd service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received event network-vif-unplugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-a750661f-4ea0-4960-9013-c79375b4194e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating instance_info_cache with network_info: [{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a750661f-4ea0-4960-9013-c79375b4194e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Releasing lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a750661f-4ea0-4960-9013-c79375b4194e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'flavor' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-7cc2b0bc-93a4-41e0-99fd-03ac3ad0ba86 req-d370fd82-dde9-4c59-bc0f-d1bee5d321c7 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7cc2b0bc-93a4-41e0-99fd-03ac3ad0ba86 req-d370fd82-dde9-4c59-bc0f-d1bee5d321c7 service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7cc2b0bc-93a4-41e0-99fd-03ac3ad0ba86 req-d370fd82-dde9-4c59-bc0f-d1bee5d321c7 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7cc2b0bc-93a4-41e0-99fd-03ac3ad0ba86 req-d370fd82-dde9-4c59-bc0f-d1bee5d321c7 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-7cc2b0bc-93a4-41e0-99fd-03ac3ad0ba86 req-d370fd82-dde9-4c59-bc0f-d1bee5d321c7 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:24 user nova-compute[70659]: WARNING nova.compute.manager [req-7cc2b0bc-93a4-41e0-99fd-03ac3ad0ba86 req-d370fd82-dde9-4c59-bc0f-d1bee5d321c7 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Instance destroyed successfully.
Jul 25 16:58:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Instance destroyed successfully.
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.objects.instance [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'resources' on Instance uuid f8fe25a3-fe0b-40a6-ad75-cdef0924154d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1458644841',display_name='tempest-VolumesSnapshotTestJSON-instance-1458644841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1458644841',id=25,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8wpz0BnsnWe4od+gCfkMb/Ba5t4TsAQM3Upq8zLDBarEfAeYwPdSN4SPpuKdUn+OU9DUYKzDypA5psTpEwQ1hvFKEejmXQg/MYpNtlbdg4Caqh2m4CFqSW/5Tc0FN6w==',key_name='tempest-keypair-178804725',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:56:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='299fab0987cc403994552275bf4a8e6e',ramdisk_id='',reservation_id='r-936waw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-772652394',owner_user_name='tempest-VolumesSnapshotTestJSON-772652394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaa312fa9268469da0d93402717c0798',uuid=f8fe25a3-fe0b-40a6-ad75-cdef0924154d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converting VIF {"id": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "address": "fa:16:3e:cc:e0:f1", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ba5ed02-82", "ovs_interfaceid": "5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e0:f1,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ed02-82') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_vif [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e0:f1,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ed02-82') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ba5ed02-82, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: INFO os_vif [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e0:f1,bridge_name='br-int',has_traffic_filtering=True,id=5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ba5ed02-82')
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RECiuPoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:24 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02586eb-394e-4ca6-b5e6-00955b69b92c', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1735cfec-6068-4d14-a48c-5e6c2fbe6eee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bb1ba3-f1f5-4086-8da2-699c26b521d0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:24 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:24 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:24 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:24 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd28298af0>, {}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Disconnecting from: [] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] <== disconnect_volume: return (53ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:58:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Deleting instance files /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d_del
Jul 25 16:58:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Deletion of /opt/stack/data/nova/instances/f8fe25a3-fe0b-40a6-ad75-cdef0924154d_del complete
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: INFO nova.compute.manager [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Took 1.41 seconds to destroy the instance on the hypervisor.
Jul 25 16:58:24 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304290.0371435, 0abf1dbe-c66a-40f1-9901-dc71a3c95850 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:58:25 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] VM Stopped (Lifecycle Event)
Jul 25 16:58:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-34133c9a-65ca-47c7-80c9-5b87780d77c9 None None] [instance: 0abf1dbe-c66a-40f1-9901-dc71a3c95850] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:58:25 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Took 0.83 seconds to deallocate network for instance.
Jul 25 16:58:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-e4f6bebe-8fe6-417d-b1d6-ff2fcb3b1388 req-4202a5b0-3886-4097-86bc-660aa90f4636 service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received event network-vif-deleted-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:25 user nova-compute[70659]: INFO nova.compute.manager [req-e4f6bebe-8fe6-417d-b1d6-ff2fcb3b1388 req-4202a5b0-3886-4097-86bc-660aa90f4636 service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Neutron deleted interface 5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3; detaching it from the instance and deleting it from the info cache
Jul 25 16:58:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-e4f6bebe-8fe6-417d-b1d6-ff2fcb3b1388 req-4202a5b0-3886-4097-86bc-660aa90f4636 service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-e4f6bebe-8fe6-417d-b1d6-ff2fcb3b1388 req-4202a5b0-3886-4097-86bc-660aa90f4636 service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Detach interface failed, port_id=5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3, reason: Instance f8fe25a3-fe0b-40a6-ad75-cdef0924154d could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:58:25 user nova-compute[70659]: WARNING nova.volume.cinder [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Attachment 7a9c0a7f-103a-4c6f-bc5e-f71dd9b1d241 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7a9c0a7f-103a-4c6f-bc5e-f71dd9b1d241. (HTTP 404) (Request-ID: req-35e11600-da48-4e02-afea-b4fa65b6bd47)
Jul 25 16:58:25 user nova-compute[70659]: INFO nova.compute.manager [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Took 0.03 seconds to detach 1 volumes for instance.
Jul 25 16:58:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-77c909b9-bab2-40b3-b82b-828990e4f09f req-ce179fd5-acc3-4454-895b-d43c4dea411a service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received event network-vif-plugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-77c909b9-bab2-40b3-b82b-828990e4f09f req-ce179fd5-acc3-4454-895b-d43c4dea411a service nova] Acquiring lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-77c909b9-bab2-40b3-b82b-828990e4f09f req-ce179fd5-acc3-4454-895b-d43c4dea411a service nova] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-77c909b9-bab2-40b3-b82b-828990e4f09f req-ce179fd5-acc3-4454-895b-d43c4dea411a service nova] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-77c909b9-bab2-40b3-b82b-828990e4f09f req-ce179fd5-acc3-4454-895b-d43c4dea411a service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] No waiting events found dispatching network-vif-plugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:25 user nova-compute[70659]: WARNING nova.compute.manager [req-77c909b9-bab2-40b3-b82b-828990e4f09f req-ce179fd5-acc3-4454-895b-d43c4dea411a service nova] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Received unexpected event network-vif-plugged-5ba5ed02-8251-4d2f-a2c1-a87874c1a8b3 for instance with vm_state active and task_state deleting.
Jul 25 16:58:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:26 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Deleted allocations for instance f8fe25a3-fe0b-40a6-ad75-cdef0924154d
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:26 user nova-compute[70659]: WARNING nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:26 user nova-compute[70659]: WARNING nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:26 user nova-compute[70659]: WARNING nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:26 user nova-compute[70659]: WARNING nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:26 user nova-compute[70659]: WARNING nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:26 user nova-compute[70659]: WARNING nova.compute.manager [req-ebd9bb33-75a0-4099-93cc-02e73bdbdf3d req-8bfb0bd2-b30f-4c5a-930a-e16a084c539a service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:58:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e7df345e-527a-4df0-985b-10c75936a36c tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "f8fe25a3-fe0b-40a6-ad75-cdef0924154d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.891s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-28d85d39-ee8b-45b9-9df4-10dcc7addcab req-7d86eb9c-49ec-4946-b8fc-f17159517840 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-changed-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-28d85d39-ee8b-45b9-9df4-10dcc7addcab req-7d86eb9c-49ec-4946-b8fc-f17159517840 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Refreshing instance network info cache due to event network-changed-9ee6940c-69cd-42ac-841f-4a81a6f1bda8. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:58:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-28d85d39-ee8b-45b9-9df4-10dcc7addcab req-7d86eb9c-49ec-4946-b8fc-f17159517840 service nova] Acquiring lock "refresh_cache-4d852fe8-32e2-447d-8e78-f7093db56d6b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:58:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-28d85d39-ee8b-45b9-9df4-10dcc7addcab req-7d86eb9c-49ec-4946-b8fc-f17159517840 service nova] Acquired lock "refresh_cache-4d852fe8-32e2-447d-8e78-f7093db56d6b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:58:27 user nova-compute[70659]: DEBUG nova.network.neutron [req-28d85d39-ee8b-45b9-9df4-10dcc7addcab req-7d86eb9c-49ec-4946-b8fc-f17159517840 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Refreshing network info cache for port 9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for 51c336bc-e646-4429-809d-354ae03bd8d6 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304308.1486123, 51c336bc-e646-4429-809d-354ae03bd8d6 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:58:28 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] VM Resumed (Lifecycle Event)
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-a750661f-4ea0-4960-9013-c79375b4194e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-ae3e1903-a8e1-4804-82a4-dbdfb6480bd6 req-31c45912-6578-445a-9dfe-e6b858371287 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ae3e1903-a8e1-4804-82a4-dbdfb6480bd6 req-31c45912-6578-445a-9dfe-e6b858371287 service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ae3e1903-a8e1-4804-82a4-dbdfb6480bd6 req-31c45912-6578-445a-9dfe-e6b858371287 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ae3e1903-a8e1-4804-82a4-dbdfb6480bd6 req-31c45912-6578-445a-9dfe-e6b858371287 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-ae3e1903-a8e1-4804-82a4-dbdfb6480bd6 req-31c45912-6578-445a-9dfe-e6b858371287 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:28 user nova-compute[70659]: WARNING nova.compute.manager [req-ae3e1903-a8e1-4804-82a4-dbdfb6480bd6 req-31c45912-6578-445a-9dfe-e6b858371287 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state rescued and task_state unrescuing.
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:58:28 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304308.149088, 51c336bc-e646-4429-809d-354ae03bd8d6 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:58:28 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] VM Started (Lifecycle Event)
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-28d85d39-ee8b-45b9-9df4-10dcc7addcab req-7d86eb9c-49ec-4946-b8fc-f17159517840 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Updated VIF entry in instance network info cache for port 9ee6940c-69cd-42ac-841f-4a81a6f1bda8. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-28d85d39-ee8b-45b9-9df4-10dcc7addcab req-7d86eb9c-49ec-4946-b8fc-f17159517840 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Updating instance_info_cache with network_info: [{"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:58:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-28d85d39-ee8b-45b9-9df4-10dcc7addcab req-7d86eb9c-49ec-4946-b8fc-f17159517840 service nova] Releasing lock "refresh_cache-4d852fe8-32e2-447d-8e78-f7093db56d6b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:58:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG nova.objects.instance [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:31 user nova-compute[70659]: INFO nova.compute.manager [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attaching volume 477d4534-bcd9-4902-a894-93ae1ddc772a to /dev/vdb
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG os_brick.utils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15df3fe-6152-4533-8539-d2612ecf91fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a2358b-1643-46ce-bea6-41fb56964a58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b49bc8a-c5ca-4220-9d66-795a899d9edf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78e1961-6a0b-495c-ac1b-9886bf6c05c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:58:32 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[394bdef3-2709-4ec1-8bf0-86102f303803]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.utils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updating existing volume attachment record: e4b5783e-d04c-4a4e-9aeb-bf98728c32de {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:32 user nova-compute[70659]: INFO nova.compute.manager [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Attaching volume 671dc915-fd94-44fe-9979-8043d6a8a300 to /dev/vdb
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.utils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ff1a01-c588-485d-bdf0-60d9ec8f9a3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[975e45eb-69ea-4729-a698-9386a10163b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8f2263-e70e-459d-bd3e-35a88f379f66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fa2d64-35dd-4bdc-a737-e501fb1614e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:58:32 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:58:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2bfb90-736f-4e5b-b1f0-527f58dacb5a]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG os_brick.utils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:32 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Updating existing volume attachment record: 871bff97-2358-4150-bc21-959a78e3ba4c {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:58:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwrDQWBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:39 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d7083e-99ea-42ba-9336-0070d331df40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:58:39 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f73813-a9e6-4a43-b952-9738ed7baea5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a] added
Jul 25 16:58:39 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[023fe931-7ae8-4da2-a487-8f3724645f74]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4448470-0e3a-473a-8d86-07df3acac4f5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwrDQWBA {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwrDQWBA" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4e941e-1662-4667-8359-24acbb68f5af]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwrDQWBA'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c58f9d-d76d-4085-a24a-8965fef3fcf4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[95839626-34f9-4e27-8010-079331d6a204]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:39 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:39 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:39 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:39 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5239a4cd-5fae-4cb1-8452-6051591de507]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a, portal: 172.16.0.220,3260]
Jul 25 16:58:39 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a, portal: 172.16.0.220,3260] successful.
Jul 25 16:58:39 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[997ad201-cd14-43e0-bbff-19c268971813]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[934652f9-486e-429a-b632-61c17a00a316]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:39 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:39 user nova-compute[70659]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)
Jul 25 16:58:39 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:39 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:39 user nova-compute[70659]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)
Jul 25 16:58:39 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb38334-e4e5-4737-824b-38b909a51c2d]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwrDQWBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxlHQCce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304304.539448, f8fe25a3-fe0b-40a6-ad75-cdef0924154d => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:58:39 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] VM Stopped (Lifecycle Event)
Jul 25 16:58:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ba1e7e7c-377b-41e5-ba73-caa4301caf68 None None] [instance: f8fe25a3-fe0b-40a6-ad75-cdef0924154d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:58:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23534663366356661', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534663366356661', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.997s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:40 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:40 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG nova.objects.instance [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:58:40 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:40 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:58:40 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:58:40 user nova-compute[70659]:   <serial>477d4534-bcd9-4902-a894-93ae1ddc772a</serial>
Jul 25 16:58:40 user nova-compute[70659]: </disk>
Jul 25 16:58:40 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c0bbf8-f1f2-4b9e-b080-2d30f6fc168d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:58:40 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[04492fb6-7345-4cd3-86de-d4a42d49f128]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300] added
Jul 25 16:58:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd123f28-f3a2-4a08-9336-d1c617acf5aa]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e3fd9b-cb01-4fd9-ab4a-8b4a7f635a86]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxlHQCce {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxlHQCce" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f979e9f1-f59b-41de-99b2-cb8fbfe5f710]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sxlHQCce'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba99874-17a8-4ba5-9499-22e54a46de94]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23bb36d-01b0-4712-afcc-2fb44692fb39]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)
Jul 25 16:58:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)
Jul 25 16:58:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88e3f02-183e-4b7c-ad40-2b26d2fb7755]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300, portal: 172.16.0.220,3260]
Jul 25 16:58:40 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300, portal: 172.16.0.220,3260] successful.
Jul 25 16:58:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f504137d-64de-4126-8d0a-3ba40ab11e5e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de6e08-9e74-4b3b-a803-3e3d99b42681]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)
Jul 25 16:58:40 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6afabfb-66cd-4a32-a925-6b56b76cf1a4]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxlHQCce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:58:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] No VIF found with MAC fa:16:3e:56:91:c8, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:58:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-da38af46-3ab1-46e3-8805-0c49715bf07f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.213s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== connect_volume: return (2410ms) {'type': 'block', 'scsi_wwn': '26162306638643763', 'path': '/dev/sde'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162306638643763', 'path': '/dev/sde'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:58:41 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:58:41 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:41 user nova-compute[70659]:   <source dev="/dev/sde"/>
Jul 25 16:58:41 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:58:41 user nova-compute[70659]:   <serial>671dc915-fd94-44fe-9979-8043d6a8a300</serial>
Jul 25 16:58:41 user nova-compute[70659]: </disk>
Jul 25 16:58:41 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:58:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:58:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:58:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No VIF found with MAC fa:16:3e:63:69:77, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:58:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a4da7576-828f-48df-adfa-d4427954249d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.285s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:43 user nova-compute[70659]: INFO nova.compute.manager [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Detaching volume 477d4534-bcd9-4902-a894-93ae1ddc772a
Jul 25 16:58:43 user nova-compute[70659]: INFO nova.virt.block_device [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Attempting to driver detach volume 477d4534-bcd9-4902-a894-93ae1ddc772a from mountpoint /dev/vdb
Jul 25 16:58:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Attempting to detach device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:58:43 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:43 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:58:43 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:58:43 user nova-compute[70659]:   <serial>477d4534-bcd9-4902-a894-93ae1ddc772a</serial>
Jul 25 16:58:43 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:58:43 user nova-compute[70659]: </disk>
Jul 25 16:58:43 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:58:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully detached device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the persistent domain config.
Jul 25 16:58:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:58:43 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:43 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:58:43 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:58:43 user nova-compute[70659]:   <serial>477d4534-bcd9-4902-a894-93ae1ddc772a</serial>
Jul 25 16:58:43 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:58:43 user nova-compute[70659]: </disk>
Jul 25 16:58:43 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304323.5720756, f6fba6f6-ff72-43c2-b824-f262bf430eac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:58:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully detached device vdb from instance f6fba6f6-ff72-43c2-b824-f262bf430eac from the live domain config.
Jul 25 16:58:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwrDQWBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:43 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a640b7fe-6b71-4541-97b5-5c4cec71eafd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55273fa-3c0a-4845-8c14-a175d1ccc495]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:43 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:43 user nova-compute[70659]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)
Jul 25 16:58:43 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:43 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:43 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:43 user nova-compute[70659]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a (non-flash)
Jul 25 16:58:43 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:43 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd306cc4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b26d5-5d54-4589-ba6a-ebfd16793991]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0339f307-9d0b-4a0e-b83f-e8e48409114b]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dafffa4-acd5-4a14-9dd8-9caf2ef7ccda]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d543f35c-eb9c-404e-9676-32ea9882ba3f]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[febc9447-9544-4371-956a-9cc4e942f726]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9adfec1-0a9e-4557-a979-779a458bee6b]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a, portal: 172.16.0.220,3260]
Jul 25 16:58:43 user nova-compute[70659]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a, portal: 172.16.0.220,3260] successful.
Jul 25 16:58:43 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477d4534-bcd9-4902-a894-93ae1ddc772a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68c6d59-25e2-4f9b-8dbc-4eb203599884]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] <== disconnect_volume: return (305ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:58:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'flavor' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-588102e3-f4af-42c5-97dc-897da433283f tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:45 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:45 user nova-compute[70659]: INFO nova.compute.manager [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Attaching volume daf637d8-cb06-4c5e-a3f1-29d4df74242d to /dev/vdc
Jul 25 16:58:46 user nova-compute[70659]: DEBUG os_brick.utils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b417233-6032-4330-8426-2844afa27b6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0449c9-e123-4716-820c-5c9b6dbba958]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[79809d29-7fd7-40fe-ab2e-7b0cf7894a8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f65587b-57e2-44c8-9edc-8ac13ee7c34f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:58:46 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:58:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db9bb38-19d7-4163-b7f7-c9ebe5fddde8]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG os_brick.utils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Updating existing volume attachment record: b00c5b52-855e-4d36-aacc-78f0ad26e341 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:58:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:58:47 user nova-compute[70659]: INFO nova.compute.claims [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Claim successful on node user
Jul 25 16:58:47 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:58:47 user nova-compute[70659]: DEBUG nova.network.neutron [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:58:47 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:58:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG nova.policy [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f29db3ae5934862b72e71e6863b46a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a3bf6c11a04274b5059bd9dd6be00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:58:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Creating image(s)
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.158s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk 1073741824" returned: 0 in 0.051s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Cannot resize image /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG nova.objects.instance [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'migration_context' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Ensure instance console log exists: /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Successfully created port: 2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:58:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:49 user nova-compute[70659]: DEBUG nova.network.neutron [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Successfully updated port: 2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:58:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:58:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquired lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:58:49 user nova-compute[70659]: DEBUG nova.network.neutron [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:58:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-0baa3e5a-b497-4548-82c3-bd55fe8137c2 req-6806161a-57d8-45b4-8d98-7a0803f26690 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-changed-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-0baa3e5a-b497-4548-82c3-bd55fe8137c2 req-6806161a-57d8-45b4-8d98-7a0803f26690 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Refreshing instance network info cache due to event network-changed-2522dddf-d653-4f79-9db4-4785f9566253. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:58:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0baa3e5a-b497-4548-82c3-bd55fe8137c2 req-6806161a-57d8-45b4-8d98-7a0803f26690 service nova] Acquiring lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:58:49 user nova-compute[70659]: DEBUG nova.network.neutron [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating instance_info_cache with network_info: [{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Releasing lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Instance network_info: |[{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0baa3e5a-b497-4548-82c3-bd55fe8137c2 req-6806161a-57d8-45b4-8d98-7a0803f26690 service nova] Acquired lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.network.neutron [req-0baa3e5a-b497-4548-82c3-bd55fe8137c2 req-6806161a-57d8-45b4-8d98-7a0803f26690 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Refreshing network info cache for port 2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Start _get_guest_xml network_info=[{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:58:50 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:58:50 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1260012504',display_name='tempest-ServerActionsTestOtherA-server-1260012504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1260012504',id=29,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-b5pqhqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=612d6677-e182-4337-a33e-622efb364df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.objects.instance [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'pci_devices' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:58:50 user nova-compute[70659]:   <uuid>612d6677-e182-4337-a33e-622efb364df2</uuid>
Jul 25 16:58:50 user nova-compute[70659]:   <name>instance-0000001d</name>
Jul 25 16:58:50 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:58:50 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:58:50 user nova-compute[70659]:   <metadata>
Jul 25 16:58:50 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:58:50 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:58:50 user nova-compute[70659]:       <nova:name>tempest-ServerActionsTestOtherA-server-1260012504</nova:name>
Jul 25 16:58:50 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:58:50</nova:creationTime>
Jul 25 16:58:50 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:58:50 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:58:50 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:58:50 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:58:50 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:58:50 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:58:50 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:58:50 user nova-compute[70659]:       <nova:owner>
Jul 25 16:58:50 user nova-compute[70659]:         <nova:user uuid="4f29db3ae5934862b72e71e6863b46a6">tempest-ServerActionsTestOtherA-1965201562-project-member</nova:user>
Jul 25 16:58:50 user nova-compute[70659]:         <nova:project uuid="77a3bf6c11a04274b5059bd9dd6be00e">tempest-ServerActionsTestOtherA-1965201562</nova:project>
Jul 25 16:58:50 user nova-compute[70659]:       </nova:owner>
Jul 25 16:58:50 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:58:50 user nova-compute[70659]:       <nova:ports>
Jul 25 16:58:50 user nova-compute[70659]:         <nova:port uuid="2522dddf-d653-4f79-9db4-4785f9566253">
Jul 25 16:58:50 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:58:50 user nova-compute[70659]:         </nova:port>
Jul 25 16:58:50 user nova-compute[70659]:       </nova:ports>
Jul 25 16:58:50 user nova-compute[70659]:     </nova:instance>
Jul 25 16:58:50 user nova-compute[70659]:   </metadata>
Jul 25 16:58:50 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:58:50 user nova-compute[70659]:     <system>
Jul 25 16:58:50 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:58:50 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:58:50 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:58:50 user nova-compute[70659]:       <entry name="serial">612d6677-e182-4337-a33e-622efb364df2</entry>
Jul 25 16:58:50 user nova-compute[70659]:       <entry name="uuid">612d6677-e182-4337-a33e-622efb364df2</entry>
Jul 25 16:58:50 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:58:50 user nova-compute[70659]:     </system>
Jul 25 16:58:50 user nova-compute[70659]:   </sysinfo>
Jul 25 16:58:50 user nova-compute[70659]:   <os>
Jul 25 16:58:50 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:58:50 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:58:50 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:58:50 user nova-compute[70659]:   </os>
Jul 25 16:58:50 user nova-compute[70659]:   <features>
Jul 25 16:58:50 user nova-compute[70659]:     <acpi/>
Jul 25 16:58:50 user nova-compute[70659]:     <apic/>
Jul 25 16:58:50 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:58:50 user nova-compute[70659]:   </features>
Jul 25 16:58:50 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:58:50 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:58:50 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:58:50 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:58:50 user nova-compute[70659]:   </clock>
Jul 25 16:58:50 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:58:50 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:58:50 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:58:50 user nova-compute[70659]:   </cpu>
Jul 25 16:58:50 user nova-compute[70659]:   <devices>
Jul 25 16:58:50 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:58:50 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:58:50 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk"/>
Jul 25 16:58:50 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:58:50 user nova-compute[70659]:     </disk>
Jul 25 16:58:50 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:58:50 user nova-compute[70659]:       <mac address="fa:16:3e:a5:e2:58"/>
Jul 25 16:58:50 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:58:50 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:58:50 user nova-compute[70659]:       <target dev="tap2522dddf-d6"/>
Jul 25 16:58:50 user nova-compute[70659]:     </interface>
Jul 25 16:58:50 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:58:50 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/console.log" append="off"/>
Jul 25 16:58:50 user nova-compute[70659]:     </serial>
Jul 25 16:58:50 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:58:50 user nova-compute[70659]:     <video>
Jul 25 16:58:50 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:58:50 user nova-compute[70659]:     </video>
Jul 25 16:58:50 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:58:50 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:58:50 user nova-compute[70659]:     </rng>
Jul 25 16:58:50 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:58:50 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:58:50 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:58:50 user nova-compute[70659]:     </memballoon>
Jul 25 16:58:50 user nova-compute[70659]:   </devices>
Jul 25 16:58:50 user nova-compute[70659]: </domain>
Jul 25 16:58:50 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1260012504',display_name='tempest-ServerActionsTestOtherA-server-1260012504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1260012504',id=29,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-b5pqhqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=612d6677-e182-4337-a33e-622efb364df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG os_vif [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2522dddf-d6, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2522dddf-d6, col_values=(('external_ids', {'iface-id': '2522dddf-d653-4f79-9db4-4785f9566253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:e2:58', 'vm-uuid': '612d6677-e182-4337-a33e-622efb364df2'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:50 user nova-compute[70659]: INFO os_vif [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6')
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No VIF found with MAC fa:16:3e:a5:e2:58, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.network.neutron [req-0baa3e5a-b497-4548-82c3-bd55fe8137c2 req-6806161a-57d8-45b4-8d98-7a0803f26690 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updated VIF entry in instance network info cache for port 2522dddf-d653-4f79-9db4-4785f9566253. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG nova.network.neutron [req-0baa3e5a-b497-4548-82c3-bd55fe8137c2 req-6806161a-57d8-45b4-8d98-7a0803f26690 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating instance_info_cache with network_info: [{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:58:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0baa3e5a-b497-4548-82c3-bd55fe8137c2 req-6806161a-57d8-45b4-8d98-7a0803f26690 service nova] Releasing lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "12231bca-69a7-4cc4-a7bf-959d4c818339" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:51 user nova-compute[70659]: INFO nova.compute.manager [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Terminating instance
Jul 25 16:58:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-a23f9639-58b5-4b2a-964d-5734b89f959d req-35a8524a-63d2-4feb-ac27-d68dc778bcfc service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a23f9639-58b5-4b2a-964d-5734b89f959d req-35a8524a-63d2-4feb-ac27-d68dc778bcfc service nova] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a23f9639-58b5-4b2a-964d-5734b89f959d req-35a8524a-63d2-4feb-ac27-d68dc778bcfc service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a23f9639-58b5-4b2a-964d-5734b89f959d req-35a8524a-63d2-4feb-ac27-d68dc778bcfc service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-a23f9639-58b5-4b2a-964d-5734b89f959d req-35a8524a-63d2-4feb-ac27-d68dc778bcfc service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] No waiting events found dispatching network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:52 user nova-compute[70659]: WARNING nova.compute.manager [req-a23f9639-58b5-4b2a-964d-5734b89f959d req-35a8524a-63d2-4feb-ac27-d68dc778bcfc service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received unexpected event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 for instance with vm_state building and task_state spawning.
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb2b37cb-99ac-4f64-9f73-bed088c4f527 req-4d7d47a9-b3c9-4f42-b8e5-3ecf179afc48 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received event network-vif-unplugged-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb2b37cb-99ac-4f64-9f73-bed088c4f527 req-4d7d47a9-b3c9-4f42-b8e5-3ecf179afc48 service nova] Acquiring lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb2b37cb-99ac-4f64-9f73-bed088c4f527 req-4d7d47a9-b3c9-4f42-b8e5-3ecf179afc48 service nova] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb2b37cb-99ac-4f64-9f73-bed088c4f527 req-4d7d47a9-b3c9-4f42-b8e5-3ecf179afc48 service nova] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb2b37cb-99ac-4f64-9f73-bed088c4f527 req-4d7d47a9-b3c9-4f42-b8e5-3ecf179afc48 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] No waiting events found dispatching network-vif-unplugged-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb2b37cb-99ac-4f64-9f73-bed088c4f527 req-4d7d47a9-b3c9-4f42-b8e5-3ecf179afc48 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received event network-vif-unplugged-48919998-7805-43ca-b9dc-11bf1e3015ee for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQtfPxkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:53 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:53 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:53 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:58:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Instance destroyed successfully.
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG nova.objects.instance [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lazy-loading 'resources' on Instance uuid 12231bca-69a7-4cc4-a7bf-959d4c818339 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-761733388',display_name='tempest-VolumesActionsTest-instance-761733388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-761733388',id=28,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fa968e78b2f4b8eac3f96aefa36aa4b',ramdisk_id='',reservation_id='r-16r3ffzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-848179361',owner_user_name='tempest-VolumesActionsTest-848179361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:57:07Z,user_data=None,user_id='fa556ea48af74f00887d740c81841879',uuid=12231bca-69a7-4cc4-a7bf-959d4c818339,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converting VIF {"id": "48919998-7805-43ca-b9dc-11bf1e3015ee", "address": "fa:16:3e:f6:f4:ec", "network": {"id": "67316ae7-bc45-455d-9437-8a665aec0a2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1304663396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa968e78b2f4b8eac3f96aefa36aa4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48919998-78", "ovs_interfaceid": "48919998-7805-43ca-b9dc-11bf1e3015ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f4:ec,bridge_name='br-int',has_traffic_filtering=True,id=48919998-7805-43ca-b9dc-11bf1e3015ee,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48919998-78') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_vif [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f4:ec,bridge_name='br-int',has_traffic_filtering=True,id=48919998-7805-43ca-b9dc-11bf1e3015ee,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48919998-78') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f27d4bd-47fe-4f4e-a018-39434fa50cd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:58:53 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48919998-78, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:58:53 user nova-compute[70659]: INFO os_vif [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f4:ec,bridge_name='br-int',has_traffic_filtering=True,id=48919998-7805-43ca-b9dc-11bf1e3015ee,network=Network(67316ae7-bc45-455d-9437-8a665aec0a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48919998-78')
Jul 25 16:58:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Deleting instance files /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339_del
Jul 25 16:58:53 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Deletion of /opt/stack/data/nova/instances/12231bca-69a7-4cc4-a7bf-959d4c818339_del complete
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea5a9de-7b54-4be3-9b92-336f339e525a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d] added
Jul 25 16:58:53 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[863f8abd-7e88-449b-a7ab-fcb6e44393c6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b66211e-8e99-49f0-aae5-07ab80cb2934]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQtfPxkh {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: INFO nova.compute.manager [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Took 1.56 seconds to destroy the instance on the hypervisor.
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQtfPxkh" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[be251a20-8783-4fd6-9d56-8580afb9e8e7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sQtfPxkh'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e958df70-0c84-4ba5-a99b-af575517f055]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5caa96-04ec-4cf3-978a-35e2629713bb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87325fd-9a9f-4ed5-b65d-a3d0a03821ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d, portal: 172.16.0.220,3260]
Jul 25 16:58:53 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d, portal: 172.16.0.220,3260] successful.
Jul 25 16:58:53 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9097ceb1-583c-44da-a18c-b1af4f63967c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5bc138-2311-4806-acba-f3e62be26e6d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d (non-flash)
Jul 25 16:58:53 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:53 user nova-compute[70659]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d (non-flash)
Jul 25 16:58:53 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e5dfdb-e7c2-4e15-b0da-e3114599e099]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQtfPxkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304334.038444, 612d6677-e182-4337-a33e-622efb364df2 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:58:54 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] VM Resumed (Lifecycle Event)
Jul 25 16:58:54 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Took 0.63 seconds to deallocate network for instance.
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:54 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] Instance spawned successfully.
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b81c485f-3498-46f1-9eef-f8451d7dae1e req-f529e09c-8e77-4fbb-a785-b1e272df51d0 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b81c485f-3498-46f1-9eef-f8451d7dae1e req-f529e09c-8e77-4fbb-a785-b1e272df51d0 service nova] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b81c485f-3498-46f1-9eef-f8451d7dae1e req-f529e09c-8e77-4fbb-a785-b1e272df51d0 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b81c485f-3498-46f1-9eef-f8451d7dae1e req-f529e09c-8e77-4fbb-a785-b1e272df51d0 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b81c485f-3498-46f1-9eef-f8451d7dae1e req-f529e09c-8e77-4fbb-a785-b1e272df51d0 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] No waiting events found dispatching network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:54 user nova-compute[70659]: WARNING nova.compute.manager [req-b81c485f-3498-46f1-9eef-f8451d7dae1e req-f529e09c-8e77-4fbb-a785-b1e272df51d0 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received unexpected event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 for instance with vm_state building and task_state spawning.
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b81c485f-3498-46f1-9eef-f8451d7dae1e req-f529e09c-8e77-4fbb-a785-b1e272df51d0 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received event network-vif-deleted-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:54 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304334.049275, 612d6677-e182-4337-a33e-622efb364df2 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:58:54 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] VM Started (Lifecycle Event)
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:58:54 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:54 user nova-compute[70659]: INFO nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Took 6.21 seconds to spawn the instance on the hypervisor.
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-7d3e32ba-dbc1-482f-a58f-571f68db5809 req-ea0a2989-4d70-4886-b603-28c72ddca032 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received event network-vif-plugged-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7d3e32ba-dbc1-482f-a58f-571f68db5809 req-ea0a2989-4d70-4886-b603-28c72ddca032 service nova] Acquiring lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7d3e32ba-dbc1-482f-a58f-571f68db5809 req-ea0a2989-4d70-4886-b603-28c72ddca032 service nova] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7d3e32ba-dbc1-482f-a58f-571f68db5809 req-ea0a2989-4d70-4886-b603-28c72ddca032 service nova] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-7d3e32ba-dbc1-482f-a58f-571f68db5809 req-ea0a2989-4d70-4886-b603-28c72ddca032 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] No waiting events found dispatching network-vif-plugged-48919998-7805-43ca-b9dc-11bf1e3015ee {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:58:54 user nova-compute[70659]: WARNING nova.compute.manager [req-7d3e32ba-dbc1-482f-a58f-571f68db5809 req-ea0a2989-4d70-4886-b603-28c72ddca032 service nova] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Received unexpected event network-vif-plugged-48919998-7805-43ca-b9dc-11bf1e3015ee for instance with vm_state deleted and task_state None.
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:54 user nova-compute[70659]: INFO nova.compute.manager [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Took 7.21 seconds to build instance.
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc8-85ea-4c16-b1bd-a23533abc443 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.327s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23838666265366164', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838666265366164', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:54 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Deleted allocations for instance 12231bca-69a7-4cc4-a7bf-959d4c818339
Jul 25 16:58:54 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:58:54 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:54 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:58:54 user nova-compute[70659]:   <target dev="vdc" bus="virtio"/>
Jul 25 16:58:54 user nova-compute[70659]:   <serial>daf637d8-cb06-4c5e-a3f1-29d4df74242d</serial>
Jul 25 16:58:54 user nova-compute[70659]: </disk>
Jul 25 16:58:54 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f83c3ebd-e257-44a9-8863-3e8fcdac0336 tempest-VolumesActionsTest-848179361 tempest-VolumesActionsTest-848179361-project-member] Lock "12231bca-69a7-4cc4-a7bf-959d4c818339" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] No VIF found with MAC fa:16:3e:63:69:77, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b1cf52d8-66f9-44f2-b85c-2b258b7effc0 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.512s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:56 user nova-compute[70659]: INFO nova.compute.manager [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Detaching volume 671dc915-fd94-44fe-9979-8043d6a8a300
Jul 25 16:58:56 user nova-compute[70659]: INFO nova.virt.block_device [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Attempting to driver detach volume 671dc915-fd94-44fe-9979-8043d6a8a300 from mountpoint /dev/vdb
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Attempting to detach device vdb from instance 4d852fe8-32e2-447d-8e78-f7093db56d6b from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:58:56 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:56 user nova-compute[70659]:   <source dev="/dev/sde"/>
Jul 25 16:58:56 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:58:56 user nova-compute[70659]:   <serial>671dc915-fd94-44fe-9979-8043d6a8a300</serial>
Jul 25 16:58:56 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:58:56 user nova-compute[70659]: </disk>
Jul 25 16:58:56 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:58:56 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully detached device vdb from instance 4d852fe8-32e2-447d-8e78-f7093db56d6b from the persistent domain config.
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d852fe8-32e2-447d-8e78-f7093db56d6b from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:58:56 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:56 user nova-compute[70659]:   <source dev="/dev/sde"/>
Jul 25 16:58:56 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:58:56 user nova-compute[70659]:   <serial>671dc915-fd94-44fe-9979-8043d6a8a300</serial>
Jul 25 16:58:56 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:58:56 user nova-compute[70659]: </disk>
Jul 25 16:58:56 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304336.846899, 4d852fe8-32e2-447d-8e78-f7093db56d6b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:58:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:58:56 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully detached device vdb from instance 4d852fe8-32e2-447d-8e78-f7093db56d6b from the live domain config.
Jul 25 16:58:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxlHQCce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:58:57 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:57 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:58:57 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7520MB free_disk=25.227157592773438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[df81be8d-a14d-435c-8565-750bec9d6baf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b760e1f-963b-4059-be52-c25042d52d74]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:57 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:57 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:57 user nova-compute[70659]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d (non-flash)
Jul 25 16:58:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:58:57 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:58:57 user nova-compute[70659]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 (non-flash)
Jul 25 16:58:57 user nova-compute[70659]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d (non-flash)
Jul 25 16:58:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd306a9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300'): ({'sde'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Removing single pathed devices sde {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fac15e-e501-460b-979c-0f408427b312]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd7dc6-c8b9-4563-ac36-20a6af2e844e]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flushing IO for device /dev/sde {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f54fe-d943-4fbc-a38f-d540e9687bd7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f6fba6f6-ff72-43c2-b824-f262bf430eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 51c336bc-e646-4429-809d-354ae03bd8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 4d852fe8-32e2-447d-8e78-f7093db56d6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f201428e-c462-4cf2-881c-6712801f2e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae9b0a1-5f22-4cab-85cf-0db87784c742]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bc7f9a-7cde-4401-87ca-7137e3978776]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e42dc-e108-47bf-835a-74d8ba448577]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300, portal: 172.16.0.220,3260]
Jul 25 16:58:57 user nova-compute[70659]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300, portal: 172.16.0.220,3260] successful.
Jul 25 16:58:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:671dc915-fd94-44fe-9979-8043d6a8a300 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5cd88e-3e06-4b7d-a679-a1f829f11100]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== disconnect_volume: return (348ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:58:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:58:58 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:58:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9da8877f-6e28-400f-8ab4-6f3e10a6363a tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.282s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:58:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:58:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:58:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:58:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:58:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:58:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:58:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:58:59 user nova-compute[70659]: INFO nova.compute.manager [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Detaching volume daf637d8-cb06-4c5e-a3f1-29d4df74242d
Jul 25 16:58:59 user nova-compute[70659]: INFO nova.virt.block_device [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Attempting to driver detach volume daf637d8-cb06-4c5e-a3f1-29d4df74242d from mountpoint /dev/vdc
Jul 25 16:58:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Attempting to detach device vdc from instance 4d852fe8-32e2-447d-8e78-f7093db56d6b from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:58:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:58:59 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:59 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:58:59 user nova-compute[70659]:   <target dev="vdc" bus="virtio"/>
Jul 25 16:58:59 user nova-compute[70659]:   <serial>daf637d8-cb06-4c5e-a3f1-29d4df74242d</serial>
Jul 25 16:58:59 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 16:58:59 user nova-compute[70659]: </disk>
Jul 25 16:58:59 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:58:59 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully detached device vdc from instance 4d852fe8-32e2-447d-8e78-f7093db56d6b from the persistent domain config.
Jul 25 16:58:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4d852fe8-32e2-447d-8e78-f7093db56d6b from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:58:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:58:59 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:58:59 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 16:58:59 user nova-compute[70659]:   <target dev="vdc" bus="virtio"/>
Jul 25 16:58:59 user nova-compute[70659]:   <serial>daf637d8-cb06-4c5e-a3f1-29d4df74242d</serial>
Jul 25 16:58:59 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 16:58:59 user nova-compute[70659]: </disk>
Jul 25 16:58:59 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304340.198312, 4d852fe8-32e2-447d-8e78-f7093db56d6b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:59:00 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully detached device vdc from instance 4d852fe8-32e2-447d-8e78-f7093db56d6b from the live domain config.
Jul 25 16:59:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQtfPxkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:59:00 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5062124c-9a59-44a5-934b-b4c58e92ddff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[90142ac7-e03a-4892-afed-10141b205567]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:59:00 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:59:00 user nova-compute[70659]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d (non-flash)
Jul 25 16:59:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 16:59:00 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 16:59:00 user nova-compute[70659]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d (non-flash)
Jul 25 16:59:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd303dc940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f50a88-0384-4edb-9aee-ac46c5e2433f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c159a0-8f49-4535-826c-f38916adccc0]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4829ac50-06b5-4252-8b8b-03d7a12905a5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0b5da4-2221-489a-9db0-d556b8c17a1a]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c4535c-3ea2-4be7-8f05-6c73a2a41aa6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[37afbe76-5c42-4a9f-8a4f-1b7e80ce0c43]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d, portal: 172.16.0.220,3260]
Jul 25 16:59:00 user nova-compute[70659]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d, portal: 172.16.0.220,3260] successful.
Jul 25 16:59:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf637d8-cb06-4c5e-a3f1-29d4df74242d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b45ef72-7616-488a-856a-ee062bb5d793]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] <== disconnect_volume: return (311ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updating instance_info_cache with network_info: [{"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-f6fba6f6-ff72-43c2-b824-f262bf430eac" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:59:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:59:01 user nova-compute[70659]: DEBUG nova.objects.instance [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'flavor' on Instance uuid 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:59:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5c7f2146-0907-4512-aeb0-5ee73ec021f7 tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:02 user nova-compute[70659]: INFO nova.compute.manager [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Terminating instance
Jul 25 16:59:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-bfdb89ac-92bf-47d7-9eb6-0e1184437649 req-31130642-4bf7-43b1-bb61-3e6c210f4b63 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-unplugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bfdb89ac-92bf-47d7-9eb6-0e1184437649 req-31130642-4bf7-43b1-bb61-3e6c210f4b63 service nova] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bfdb89ac-92bf-47d7-9eb6-0e1184437649 req-31130642-4bf7-43b1-bb61-3e6c210f4b63 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bfdb89ac-92bf-47d7-9eb6-0e1184437649 req-31130642-4bf7-43b1-bb61-3e6c210f4b63 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-bfdb89ac-92bf-47d7-9eb6-0e1184437649 req-31130642-4bf7-43b1-bb61-3e6c210f4b63 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] No waiting events found dispatching network-vif-unplugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-bfdb89ac-92bf-47d7-9eb6-0e1184437649 req-31130642-4bf7-43b1-bb61-3e6c210f4b63 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-unplugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Instance destroyed successfully.
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG nova.objects.instance [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lazy-loading 'resources' on Instance uuid 4d852fe8-32e2-447d-8e78-f7093db56d6b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1633613734',display_name='tempest-AttachVolumeTestJSON-server-1633613734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1633613734',id=27,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZiJbJHAX9Z7xTi8P+5WAn/yVNmiuBXLo7+nMtvi+qkyHPnxehGryMN6g/fP94Iki//wlhKyNcPS8q4k6NX4z1P8R5vFh0GDljGKzVf47Scg398AiRv8N0ncex74qQf8A==',key_name='tempest-keypair-721637731',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07de6ba95db444b5b10d51ef16525948',ramdisk_id='',reservation_id='r-c6ya5h7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-212658614',owner_user_name='tempest-AttachVolumeTestJSON-212658614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:56:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77a77d2b1954c10ace66ba38fd9ff6c',uuid=4d852fe8-32e2-447d-8e78-f7093db56d6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converting VIF {"id": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "address": "fa:16:3e:63:69:77", "network": {"id": "52ce9c3b-251f-4553-999e-3fabb0a95954", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1908437134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07de6ba95db444b5b10d51ef16525948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee6940c-69", "ovs_interfaceid": "9ee6940c-69cd-42ac-841f-4a81a6f1bda8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:69:77,bridge_name='br-int',has_traffic_filtering=True,id=9ee6940c-69cd-42ac-841f-4a81a6f1bda8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6940c-69') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG os_vif [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:69:77,bridge_name='br-int',has_traffic_filtering=True,id=9ee6940c-69cd-42ac-841f-4a81a6f1bda8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6940c-69') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ee6940c-69, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: INFO os_vif [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:69:77,bridge_name='br-int',has_traffic_filtering=True,id=9ee6940c-69cd-42ac-841f-4a81a6f1bda8,network=Network(52ce9c3b-251f-4553-999e-3fabb0a95954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee6940c-69')
Jul 25 16:59:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Deleting instance files /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b_del
Jul 25 16:59:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Deletion of /opt/stack/data/nova/instances/4d852fe8-32e2-447d-8e78-f7093db56d6b_del complete
Jul 25 16:59:03 user nova-compute[70659]: INFO nova.compute.manager [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 25 16:59:03 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] No waiting events found dispatching network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:04 user nova-compute[70659]: WARNING nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received unexpected event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 for instance with vm_state active and task_state deleting.
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] No waiting events found dispatching network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:04 user nova-compute[70659]: WARNING nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received unexpected event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 for instance with vm_state active and task_state deleting.
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] No waiting events found dispatching network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:04 user nova-compute[70659]: WARNING nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received unexpected event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 for instance with vm_state active and task_state deleting.
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-unplugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] No waiting events found dispatching network-vif-unplugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-unplugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Acquiring lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] No waiting events found dispatching network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:04 user nova-compute[70659]: WARNING nova.compute.manager [req-1a00faa6-fb0c-44ff-aa88-ce8bf9a00a63 req-a2d45783-1037-44b5-ad45-f05d7c4f6456 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received unexpected event network-vif-plugged-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 for instance with vm_state active and task_state deleting.
Jul 25 16:59:05 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:59:05 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Took 1.64 seconds to deallocate network for instance.
Jul 25 16:59:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:05 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:59:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:59:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:05 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Deleted allocations for instance 4d852fe8-32e2-447d-8e78-f7093db56d6b
Jul 25 16:59:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-56966cc0-f17c-49f2-ad21-f7f1bbe9665d tempest-AttachVolumeTestJSON-212658614 tempest-AttachVolumeTestJSON-212658614-project-member] Lock "4d852fe8-32e2-447d-8e78-f7093db56d6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.235s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-b4a80057-2634-4420-98e6-f8241c2f2674 req-d268578a-fa25-4cb0-98c5-6f5e1025a710 service nova] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Received event network-vif-deleted-9ee6940c-69cd-42ac-841f-4a81a6f1bda8 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304332.6508772, 12231bca-69a7-4cc4-a7bf-959d4c818339 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:59:07 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] VM Stopped (Lifecycle Event)
Jul 25 16:59:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ceee645c-0c56-4f71-bbd6-f16eeaaee794 None None] [instance: 12231bca-69a7-4cc4-a7bf-959d4c818339] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:07 user nova-compute[70659]: INFO nova.compute.manager [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Terminating instance
Jul 25 16:59:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-a8769efb-891f-4daa-8d5e-c59fa8e81186 req-b3beea5c-75eb-4902-8361-90e4d9c32adf service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-unplugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a8769efb-891f-4daa-8d5e-c59fa8e81186 req-b3beea5c-75eb-4902-8361-90e4d9c32adf service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a8769efb-891f-4daa-8d5e-c59fa8e81186 req-b3beea5c-75eb-4902-8361-90e4d9c32adf service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a8769efb-891f-4daa-8d5e-c59fa8e81186 req-b3beea5c-75eb-4902-8361-90e4d9c32adf service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-a8769efb-891f-4daa-8d5e-c59fa8e81186 req-b3beea5c-75eb-4902-8361-90e4d9c32adf service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-unplugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-a8769efb-891f-4daa-8d5e-c59fa8e81186 req-b3beea5c-75eb-4902-8361-90e4d9c32adf service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-unplugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Instance destroyed successfully.
Jul 25 16:59:08 user nova-compute[70659]: DEBUG nova.objects.instance [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lazy-loading 'resources' on Instance uuid f201428e-c462-4cf2-881c-6712801f2e02 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-815855632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-815855632',id=20,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEhfa9iHsO529jZd+ffyn0xgIeD3MkiLeQj4DSuZj0p+9yqHe4kmVenPeuEhWGcZMGBx9M4O28CgevctYuBC1FmZHBEY+z6gI3w9uclc7fmYcY3N0HsTx8SOr76rKzjsA==',key_name='tempest-keypair-584068859',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:57:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b9ac672b01748d191239756a58474c3',ramdisk_id='',reservation_id='r-3bjpe9kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-569325814',owner_user_name='tempest-AttachVolumeShelveTestJSON-569325814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd26fb262d7b47638bb0a0df0ea10c24',uuid=f201428e-c462-4cf2-881c-6712801f2e02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converting VIF {"id": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "address": "fa:16:3e:08:86:68", "network": {"id": "152ba8e6-3dad-431f-98c0-29594fe722df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-711950852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b9ac672b01748d191239756a58474c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4400904-3e", "ovs_interfaceid": "f4400904-3e5b-4610-af28-f24e8fa7cf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG os_vif [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4400904-3e, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:59:08 user nova-compute[70659]: INFO os_vif [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:86:68,bridge_name='br-int',has_traffic_filtering=True,id=f4400904-3e5b-4610-af28-f24e8fa7cf20,network=Network(152ba8e6-3dad-431f-98c0-29594fe722df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4400904-3e')
Jul 25 16:59:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Deleting instance files /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02_del
Jul 25 16:59:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Deletion of /opt/stack/data/nova/instances/f201428e-c462-4cf2-881c-6712801f2e02_del complete
Jul 25 16:59:08 user nova-compute[70659]: INFO nova.compute.manager [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 25 16:59:08 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:59:08 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:59:09 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:59:09 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Took 1.01 seconds to deallocate network for instance.
Jul 25 16:59:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-6a28ff23-81be-460a-96cd-c3f41501c2a7 req-c2cf16dc-0492-4856-aa98-ee7a638ccb76 service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-deleted-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:09 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:59:09 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:59:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:09 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Deleted allocations for instance f201428e-c462-4cf2-881c-6712801f2e02
Jul 25 16:59:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-958d7a46-4e62-4f4f-81f5-7c91e6809523 tempest-AttachVolumeShelveTestJSON-569325814 tempest-AttachVolumeShelveTestJSON-569325814-project-member] Lock "f201428e-c462-4cf2-881c-6712801f2e02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-b6714423-cbc0-474a-a19c-6f887769df9b req-839bde73-f329-45a7-8ad9-e5388cd1fd5d service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b6714423-cbc0-474a-a19c-6f887769df9b req-839bde73-f329-45a7-8ad9-e5388cd1fd5d service nova] Acquiring lock "f201428e-c462-4cf2-881c-6712801f2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b6714423-cbc0-474a-a19c-6f887769df9b req-839bde73-f329-45a7-8ad9-e5388cd1fd5d service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b6714423-cbc0-474a-a19c-6f887769df9b req-839bde73-f329-45a7-8ad9-e5388cd1fd5d service nova] Lock "f201428e-c462-4cf2-881c-6712801f2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-b6714423-cbc0-474a-a19c-6f887769df9b req-839bde73-f329-45a7-8ad9-e5388cd1fd5d service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] No waiting events found dispatching network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:10 user nova-compute[70659]: WARNING nova.compute.manager [req-b6714423-cbc0-474a-a19c-6f887769df9b req-839bde73-f329-45a7-8ad9-e5388cd1fd5d service nova] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Received unexpected event network-vif-plugged-f4400904-3e5b-4610-af28-f24e8fa7cf20 for instance with vm_state deleted and task_state None.
Jul 25 16:59:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:18 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304343.2421699, 4d852fe8-32e2-447d-8e78-f7093db56d6b => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:59:18 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] VM Stopped (Lifecycle Event)
Jul 25 16:59:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-231ea11a-e0f5-4ce7-bb07-bb739c179438 None None] [instance: 4d852fe8-32e2-447d-8e78-f7093db56d6b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:59:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:23 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304348.424389, f201428e-c462-4cf2-881c-6712801f2e02 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:59:23 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f201428e-c462-4cf2-881c-6712801f2e02] VM Stopped (Lifecycle Event)
Jul 25 16:59:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2c50fcac-21c7-4592-9309-54810a8bccfb None None] [instance: f201428e-c462-4cf2-881c-6712801f2e02] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:59:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:59:32 user nova-compute[70659]: INFO nova.compute.claims [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Claim successful on node user
Jul 25 16:59:32 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:59:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:59:32 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:59:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG nova.policy [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaa312fa9268469da0d93402717c0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '299fab0987cc403994552275bf4a8e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:59:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Creating image(s)
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "/opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "/opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk 1073741824" returned: 0 in 0.054s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.161s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Cannot resize image /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'migration_context' on Instance uuid e3533a51-ce1c-4d49-9cef-49cc2ebbebed {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Ensure instance console log exists: /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:33 user nova-compute[70659]: DEBUG nova.network.neutron [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Successfully created port: 96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:59:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Successfully updated port: 96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:59:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "refresh_cache-e3533a51-ce1c-4d49-9cef-49cc2ebbebed" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:59:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquired lock "refresh_cache-e3533a51-ce1c-4d49-9cef-49cc2ebbebed" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:59:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:59:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-4e78cfd1-e044-4c84-819e-2b9823076449 req-f1291b8b-ef64-43c7-a835-ad1e99c9793e service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received event network-changed-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-4e78cfd1-e044-4c84-819e-2b9823076449 req-f1291b8b-ef64-43c7-a835-ad1e99c9793e service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Refreshing instance network info cache due to event network-changed-96a5fb5e-fdd6-48d7-8340-2bf58b72be56. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:59:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4e78cfd1-e044-4c84-819e-2b9823076449 req-f1291b8b-ef64-43c7-a835-ad1e99c9793e service nova] Acquiring lock "refresh_cache-e3533a51-ce1c-4d49-9cef-49cc2ebbebed" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:59:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.network.neutron [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Updating instance_info_cache with network_info: [{"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Releasing lock "refresh_cache-e3533a51-ce1c-4d49-9cef-49cc2ebbebed" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Instance network_info: |[{"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4e78cfd1-e044-4c84-819e-2b9823076449 req-f1291b8b-ef64-43c7-a835-ad1e99c9793e service nova] Acquired lock "refresh_cache-e3533a51-ce1c-4d49-9cef-49cc2ebbebed" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.network.neutron [req-4e78cfd1-e044-4c84-819e-2b9823076449 req-f1291b8b-ef64-43c7-a835-ad1e99c9793e service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Refreshing network info cache for port 96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Start _get_guest_xml network_info=[{"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:59:35 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:59:35 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-184977354',display_name='tempest-VolumesSnapshotTestJSON-instance-184977354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-184977354',id=30,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhdVXe6RCpAVAdF4bi99g4tafxaw/zoIJgMRL6lqvUx+tvwZapqgs5V887W6HSrLAL7phvuYwisP2+1DdOc7CzTsbi3bfeDK1olkCzNgfiAeqXzGZHAay57F4HQy8PqUQ==',key_name='tempest-keypair-298492302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='299fab0987cc403994552275bf4a8e6e',ramdisk_id='',reservation_id='r-zcuvszff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-772652394',owner_user_name='tempest-VolumesSnapshotTestJSON-772652394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaa312fa9268469da0d93402717c0798',uuid=e3533a51-ce1c-4d49-9cef-49cc2ebbebed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converting VIF {"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:41:14,bridge_name='br-int',has_traffic_filtering=True,id=96a5fb5e-fdd6-48d7-8340-2bf58b72be56,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96a5fb5e-fd') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.objects.instance [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'pci_devices' on Instance uuid e3533a51-ce1c-4d49-9cef-49cc2ebbebed {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:59:35 user nova-compute[70659]:   <uuid>e3533a51-ce1c-4d49-9cef-49cc2ebbebed</uuid>
Jul 25 16:59:35 user nova-compute[70659]:   <name>instance-0000001e</name>
Jul 25 16:59:35 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:59:35 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:59:35 user nova-compute[70659]:   <metadata>
Jul 25 16:59:35 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:59:35 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:59:35 user nova-compute[70659]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-184977354</nova:name>
Jul 25 16:59:35 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:59:35</nova:creationTime>
Jul 25 16:59:35 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:59:35 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:59:35 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:59:35 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:59:35 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:59:35 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:59:35 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:59:35 user nova-compute[70659]:       <nova:owner>
Jul 25 16:59:35 user nova-compute[70659]:         <nova:user uuid="aaa312fa9268469da0d93402717c0798">tempest-VolumesSnapshotTestJSON-772652394-project-member</nova:user>
Jul 25 16:59:35 user nova-compute[70659]:         <nova:project uuid="299fab0987cc403994552275bf4a8e6e">tempest-VolumesSnapshotTestJSON-772652394</nova:project>
Jul 25 16:59:35 user nova-compute[70659]:       </nova:owner>
Jul 25 16:59:35 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:59:35 user nova-compute[70659]:       <nova:ports>
Jul 25 16:59:35 user nova-compute[70659]:         <nova:port uuid="96a5fb5e-fdd6-48d7-8340-2bf58b72be56">
Jul 25 16:59:35 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 16:59:35 user nova-compute[70659]:         </nova:port>
Jul 25 16:59:35 user nova-compute[70659]:       </nova:ports>
Jul 25 16:59:35 user nova-compute[70659]:     </nova:instance>
Jul 25 16:59:35 user nova-compute[70659]:   </metadata>
Jul 25 16:59:35 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:59:35 user nova-compute[70659]:     <system>
Jul 25 16:59:35 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:59:35 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:59:35 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:59:35 user nova-compute[70659]:       <entry name="serial">e3533a51-ce1c-4d49-9cef-49cc2ebbebed</entry>
Jul 25 16:59:35 user nova-compute[70659]:       <entry name="uuid">e3533a51-ce1c-4d49-9cef-49cc2ebbebed</entry>
Jul 25 16:59:35 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:59:35 user nova-compute[70659]:     </system>
Jul 25 16:59:35 user nova-compute[70659]:   </sysinfo>
Jul 25 16:59:35 user nova-compute[70659]:   <os>
Jul 25 16:59:35 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:59:35 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:59:35 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:59:35 user nova-compute[70659]:   </os>
Jul 25 16:59:35 user nova-compute[70659]:   <features>
Jul 25 16:59:35 user nova-compute[70659]:     <acpi/>
Jul 25 16:59:35 user nova-compute[70659]:     <apic/>
Jul 25 16:59:35 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:59:35 user nova-compute[70659]:   </features>
Jul 25 16:59:35 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:59:35 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:59:35 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:59:35 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:59:35 user nova-compute[70659]:   </clock>
Jul 25 16:59:35 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:59:35 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:59:35 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:59:35 user nova-compute[70659]:   </cpu>
Jul 25 16:59:35 user nova-compute[70659]:   <devices>
Jul 25 16:59:35 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:59:35 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:59:35 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk"/>
Jul 25 16:59:35 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:59:35 user nova-compute[70659]:     </disk>
Jul 25 16:59:35 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:59:35 user nova-compute[70659]:       <mac address="fa:16:3e:b1:41:14"/>
Jul 25 16:59:35 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:59:35 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:59:35 user nova-compute[70659]:       <target dev="tap96a5fb5e-fd"/>
Jul 25 16:59:35 user nova-compute[70659]:     </interface>
Jul 25 16:59:35 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:59:35 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/console.log" append="off"/>
Jul 25 16:59:35 user nova-compute[70659]:     </serial>
Jul 25 16:59:35 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:59:35 user nova-compute[70659]:     <video>
Jul 25 16:59:35 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:59:35 user nova-compute[70659]:     </video>
Jul 25 16:59:35 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:59:35 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:59:35 user nova-compute[70659]:     </rng>
Jul 25 16:59:35 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:59:35 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:59:35 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:59:35 user nova-compute[70659]:     </memballoon>
Jul 25 16:59:35 user nova-compute[70659]:   </devices>
Jul 25 16:59:35 user nova-compute[70659]: </domain>
Jul 25 16:59:35 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-184977354',display_name='tempest-VolumesSnapshotTestJSON-instance-184977354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-184977354',id=30,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhdVXe6RCpAVAdF4bi99g4tafxaw/zoIJgMRL6lqvUx+tvwZapqgs5V887W6HSrLAL7phvuYwisP2+1DdOc7CzTsbi3bfeDK1olkCzNgfiAeqXzGZHAay57F4HQy8PqUQ==',key_name='tempest-keypair-298492302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='299fab0987cc403994552275bf4a8e6e',ramdisk_id='',reservation_id='r-zcuvszff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-772652394',owner_user_name='tempest-VolumesSnapshotTestJSON-772652394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaa312fa9268469da0d93402717c0798',uuid=e3533a51-ce1c-4d49-9cef-49cc2ebbebed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converting VIF {"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:41:14,bridge_name='br-int',has_traffic_filtering=True,id=96a5fb5e-fdd6-48d7-8340-2bf58b72be56,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96a5fb5e-fd') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG os_vif [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:41:14,bridge_name='br-int',has_traffic_filtering=True,id=96a5fb5e-fdd6-48d7-8340-2bf58b72be56,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96a5fb5e-fd') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96a5fb5e-fd, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96a5fb5e-fd, col_values=(('external_ids', {'iface-id': '96a5fb5e-fdd6-48d7-8340-2bf58b72be56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:41:14', 'vm-uuid': 'e3533a51-ce1c-4d49-9cef-49cc2ebbebed'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:35 user nova-compute[70659]: INFO os_vif [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:41:14,bridge_name='br-int',has_traffic_filtering=True,id=96a5fb5e-fdd6-48d7-8340-2bf58b72be56,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96a5fb5e-fd')
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:59:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No VIF found with MAC fa:16:3e:b1:41:14, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:59:36 user nova-compute[70659]: DEBUG nova.network.neutron [req-4e78cfd1-e044-4c84-819e-2b9823076449 req-f1291b8b-ef64-43c7-a835-ad1e99c9793e service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Updated VIF entry in instance network info cache for port 96a5fb5e-fdd6-48d7-8340-2bf58b72be56. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:59:36 user nova-compute[70659]: DEBUG nova.network.neutron [req-4e78cfd1-e044-4c84-819e-2b9823076449 req-f1291b8b-ef64-43c7-a835-ad1e99c9793e service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Updating instance_info_cache with network_info: [{"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:59:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4e78cfd1-e044-4c84-819e-2b9823076449 req-f1291b8b-ef64-43c7-a835-ad1e99c9793e service nova] Releasing lock "refresh_cache-e3533a51-ce1c-4d49-9cef-49cc2ebbebed" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:59:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-0615e172-386b-471e-bf1a-8af69310d2b5 req-a0f1403a-4cfa-43d6-a3fc-5b0f4bfb9109 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received event network-vif-plugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0615e172-386b-471e-bf1a-8af69310d2b5 req-a0f1403a-4cfa-43d6-a3fc-5b0f4bfb9109 service nova] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0615e172-386b-471e-bf1a-8af69310d2b5 req-a0f1403a-4cfa-43d6-a3fc-5b0f4bfb9109 service nova] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0615e172-386b-471e-bf1a-8af69310d2b5 req-a0f1403a-4cfa-43d6-a3fc-5b0f4bfb9109 service nova] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-0615e172-386b-471e-bf1a-8af69310d2b5 req-a0f1403a-4cfa-43d6-a3fc-5b0f4bfb9109 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] No waiting events found dispatching network-vif-plugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:37 user nova-compute[70659]: WARNING nova.compute.manager [req-0615e172-386b-471e-bf1a-8af69310d2b5 req-a0f1403a-4cfa-43d6-a3fc-5b0f4bfb9109 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received unexpected event network-vif-plugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 for instance with vm_state building and task_state spawning.
Jul 25 16:59:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "e006724d-e45a-405f-9084-544925aaa8ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "e006724d-e45a-405f-9084-544925aaa8ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:59:37 user nova-compute[70659]: INFO nova.compute.claims [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Claim successful on node user
Jul 25 16:59:38 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:59:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:59:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG nova.policy [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '913d51a0ff3746c5bdadd59fdf14e787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef5ee6f08d04772994840a8973da621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:59:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Creating image(s)
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "/opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "/opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "/opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.162s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk 1073741824" returned: 0 in 0.051s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304379.1309302, e3533a51-ce1c-4d49-9cef-49cc2ebbebed => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:59:39 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] VM Resumed (Lifecycle Event)
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:59:39 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Instance spawned successfully.
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:39 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304379.1349983, e3533a51-ce1c-4d49-9cef-49cc2ebbebed => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:59:39 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] VM Started (Lifecycle Event)
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Cannot resize image /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.objects.instance [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'migration_context' on Instance uuid e006724d-e45a-405f-9084-544925aaa8ad {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Ensure instance console log exists: /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:39 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.network.neutron [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Successfully created port: a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:59:39 user nova-compute[70659]: INFO nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Took 6.25 seconds to spawn the instance on the hypervisor.
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:59:39 user nova-compute[70659]: INFO nova.compute.manager [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Took 7.05 seconds to build instance.
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-633c3035-74b4-4d81-a7ba-6196657be2a1 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.150s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-0d6616aa-464b-415a-856d-0285c12bfc75 req-762d6a46-cabc-457f-9afa-6427d4035fe6 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received event network-vif-plugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0d6616aa-464b-415a-856d-0285c12bfc75 req-762d6a46-cabc-457f-9afa-6427d4035fe6 service nova] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0d6616aa-464b-415a-856d-0285c12bfc75 req-762d6a46-cabc-457f-9afa-6427d4035fe6 service nova] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0d6616aa-464b-415a-856d-0285c12bfc75 req-762d6a46-cabc-457f-9afa-6427d4035fe6 service nova] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-0d6616aa-464b-415a-856d-0285c12bfc75 req-762d6a46-cabc-457f-9afa-6427d4035fe6 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] No waiting events found dispatching network-vif-plugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:39 user nova-compute[70659]: WARNING nova.compute.manager [req-0d6616aa-464b-415a-856d-0285c12bfc75 req-762d6a46-cabc-457f-9afa-6427d4035fe6 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received unexpected event network-vif-plugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 for instance with vm_state active and task_state None.
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.network.neutron [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Successfully updated port: a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "refresh_cache-e006724d-e45a-405f-9084-544925aaa8ad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquired lock "refresh_cache-e006724d-e45a-405f-9084-544925aaa8ad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.network.neutron [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-750c477f-aa17-4634-abd9-231187d612ab req-f5a8417d-c7bc-42b4-8c17-5c324f70c1a0 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received event network-changed-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-750c477f-aa17-4634-abd9-231187d612ab req-f5a8417d-c7bc-42b4-8c17-5c324f70c1a0 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Refreshing instance network info cache due to event network-changed-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-750c477f-aa17-4634-abd9-231187d612ab req-f5a8417d-c7bc-42b4-8c17-5c324f70c1a0 service nova] Acquiring lock "refresh_cache-e006724d-e45a-405f-9084-544925aaa8ad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.network.neutron [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.network.neutron [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Updating instance_info_cache with network_info: [{"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Releasing lock "refresh_cache-e006724d-e45a-405f-9084-544925aaa8ad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Instance network_info: |[{"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-750c477f-aa17-4634-abd9-231187d612ab req-f5a8417d-c7bc-42b4-8c17-5c324f70c1a0 service nova] Acquired lock "refresh_cache-e006724d-e45a-405f-9084-544925aaa8ad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.network.neutron [req-750c477f-aa17-4634-abd9-231187d612ab req-f5a8417d-c7bc-42b4-8c17-5c324f70c1a0 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Refreshing network info cache for port a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Start _get_guest_xml network_info=[{"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:59:40 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:59:40 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-230443236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-230443236',id=31,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-q70p52ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:59:38Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=e006724d-e45a-405f-9084-544925aaa8ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:0c:b8,bridge_name='br-int',has_traffic_filtering=True,id=a9a6b1a1-7294-4877-97fa-152f2cb7d2d3,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a6b1a1-72') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.objects.instance [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'pci_devices' on Instance uuid e006724d-e45a-405f-9084-544925aaa8ad {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:59:40 user nova-compute[70659]:   <uuid>e006724d-e45a-405f-9084-544925aaa8ad</uuid>
Jul 25 16:59:40 user nova-compute[70659]:   <name>instance-0000001f</name>
Jul 25 16:59:40 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 16:59:40 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 16:59:40 user nova-compute[70659]:   <metadata>
Jul 25 16:59:40 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:59:40 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 16:59:40 user nova-compute[70659]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-230443236</nova:name>
Jul 25 16:59:40 user nova-compute[70659]:       <nova:creationTime>2023-07-25 16:59:40</nova:creationTime>
Jul 25 16:59:40 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 16:59:40 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 16:59:40 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 16:59:40 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 16:59:40 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:59:40 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:59:40 user nova-compute[70659]:       </nova:flavor>
Jul 25 16:59:40 user nova-compute[70659]:       <nova:owner>
Jul 25 16:59:40 user nova-compute[70659]:         <nova:user uuid="913d51a0ff3746c5bdadd59fdf14e787">tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member</nova:user>
Jul 25 16:59:40 user nova-compute[70659]:         <nova:project uuid="1ef5ee6f08d04772994840a8973da621">tempest-ServerBootFromVolumeStableRescueTest-191665891</nova:project>
Jul 25 16:59:40 user nova-compute[70659]:       </nova:owner>
Jul 25 16:59:40 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 16:59:40 user nova-compute[70659]:       <nova:ports>
Jul 25 16:59:40 user nova-compute[70659]:         <nova:port uuid="a9a6b1a1-7294-4877-97fa-152f2cb7d2d3">
Jul 25 16:59:40 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 16:59:40 user nova-compute[70659]:         </nova:port>
Jul 25 16:59:40 user nova-compute[70659]:       </nova:ports>
Jul 25 16:59:40 user nova-compute[70659]:     </nova:instance>
Jul 25 16:59:40 user nova-compute[70659]:   </metadata>
Jul 25 16:59:40 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 16:59:40 user nova-compute[70659]:     <system>
Jul 25 16:59:40 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:59:40 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:59:40 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 16:59:40 user nova-compute[70659]:       <entry name="serial">e006724d-e45a-405f-9084-544925aaa8ad</entry>
Jul 25 16:59:40 user nova-compute[70659]:       <entry name="uuid">e006724d-e45a-405f-9084-544925aaa8ad</entry>
Jul 25 16:59:40 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:59:40 user nova-compute[70659]:     </system>
Jul 25 16:59:40 user nova-compute[70659]:   </sysinfo>
Jul 25 16:59:40 user nova-compute[70659]:   <os>
Jul 25 16:59:40 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:59:40 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 16:59:40 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 16:59:40 user nova-compute[70659]:   </os>
Jul 25 16:59:40 user nova-compute[70659]:   <features>
Jul 25 16:59:40 user nova-compute[70659]:     <acpi/>
Jul 25 16:59:40 user nova-compute[70659]:     <apic/>
Jul 25 16:59:40 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 16:59:40 user nova-compute[70659]:   </features>
Jul 25 16:59:40 user nova-compute[70659]:   <clock offset="utc">
Jul 25 16:59:40 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:59:40 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:59:40 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 16:59:40 user nova-compute[70659]:   </clock>
Jul 25 16:59:40 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 16:59:40 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 16:59:40 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:59:40 user nova-compute[70659]:   </cpu>
Jul 25 16:59:40 user nova-compute[70659]:   <devices>
Jul 25 16:59:40 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 16:59:40 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:59:40 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk"/>
Jul 25 16:59:40 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 16:59:40 user nova-compute[70659]:     </disk>
Jul 25 16:59:40 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 16:59:40 user nova-compute[70659]:       <mac address="fa:16:3e:82:0c:b8"/>
Jul 25 16:59:40 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:59:40 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 16:59:40 user nova-compute[70659]:       <target dev="tapa9a6b1a1-72"/>
Jul 25 16:59:40 user nova-compute[70659]:     </interface>
Jul 25 16:59:40 user nova-compute[70659]:     <serial type="pty">
Jul 25 16:59:40 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/console.log" append="off"/>
Jul 25 16:59:40 user nova-compute[70659]:     </serial>
Jul 25 16:59:40 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:59:40 user nova-compute[70659]:     <video>
Jul 25 16:59:40 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 16:59:40 user nova-compute[70659]:     </video>
Jul 25 16:59:40 user nova-compute[70659]:     <rng model="virtio">
Jul 25 16:59:40 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:59:40 user nova-compute[70659]:     </rng>
Jul 25 16:59:40 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:59:40 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 16:59:40 user nova-compute[70659]:       <stats period="10"/>
Jul 25 16:59:40 user nova-compute[70659]:     </memballoon>
Jul 25 16:59:40 user nova-compute[70659]:   </devices>
Jul 25 16:59:40 user nova-compute[70659]: </domain>
Jul 25 16:59:40 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-230443236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-230443236',id=31,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-q70p52ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:59:38Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=e006724d-e45a-405f-9084-544925aaa8ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:0c:b8,bridge_name='br-int',has_traffic_filtering=True,id=a9a6b1a1-7294-4877-97fa-152f2cb7d2d3,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a6b1a1-72') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG os_vif [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:0c:b8,bridge_name='br-int',has_traffic_filtering=True,id=a9a6b1a1-7294-4877-97fa-152f2cb7d2d3,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a6b1a1-72') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9a6b1a1-72, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9a6b1a1-72, col_values=(('external_ids', {'iface-id': 'a9a6b1a1-7294-4877-97fa-152f2cb7d2d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:0c:b8', 'vm-uuid': 'e006724d-e45a-405f-9084-544925aaa8ad'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:40 user nova-compute[70659]: INFO os_vif [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:0c:b8,bridge_name='br-int',has_traffic_filtering=True,id=a9a6b1a1-7294-4877-97fa-152f2cb7d2d3,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a6b1a1-72')
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:59:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No VIF found with MAC fa:16:3e:82:0c:b8, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:59:41 user nova-compute[70659]: DEBUG nova.network.neutron [req-750c477f-aa17-4634-abd9-231187d612ab req-f5a8417d-c7bc-42b4-8c17-5c324f70c1a0 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Updated VIF entry in instance network info cache for port a9a6b1a1-7294-4877-97fa-152f2cb7d2d3. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:59:41 user nova-compute[70659]: DEBUG nova.network.neutron [req-750c477f-aa17-4634-abd9-231187d612ab req-f5a8417d-c7bc-42b4-8c17-5c324f70c1a0 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Updating instance_info_cache with network_info: [{"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:59:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-750c477f-aa17-4634-abd9-231187d612ab req-f5a8417d-c7bc-42b4-8c17-5c324f70c1a0 service nova] Releasing lock "refresh_cache-e006724d-e45a-405f-9084-544925aaa8ad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-7f72797c-01c4-4050-8e6f-73c2abb96dd7 req-298ff2a4-5cfe-47f8-83de-3de1a2d0c5b2 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received event network-vif-plugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f72797c-01c4-4050-8e6f-73c2abb96dd7 req-298ff2a4-5cfe-47f8-83de-3de1a2d0c5b2 service nova] Acquiring lock "e006724d-e45a-405f-9084-544925aaa8ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f72797c-01c4-4050-8e6f-73c2abb96dd7 req-298ff2a4-5cfe-47f8-83de-3de1a2d0c5b2 service nova] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f72797c-01c4-4050-8e6f-73c2abb96dd7 req-298ff2a4-5cfe-47f8-83de-3de1a2d0c5b2 service nova] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-7f72797c-01c4-4050-8e6f-73c2abb96dd7 req-298ff2a4-5cfe-47f8-83de-3de1a2d0c5b2 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] No waiting events found dispatching network-vif-plugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:42 user nova-compute[70659]: WARNING nova.compute.manager [req-7f72797c-01c4-4050-8e6f-73c2abb96dd7 req-298ff2a4-5cfe-47f8-83de-3de1a2d0c5b2 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received unexpected event network-vif-plugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 for instance with vm_state building and task_state spawning.
Jul 25 16:59:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-768ed5e2-56e7-42ff-ab12-67630bd26be5 req-99c363c6-5a4a-481a-9b68-4bbfe24150c7 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received event network-vif-plugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-768ed5e2-56e7-42ff-ab12-67630bd26be5 req-99c363c6-5a4a-481a-9b68-4bbfe24150c7 service nova] Acquiring lock "e006724d-e45a-405f-9084-544925aaa8ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-768ed5e2-56e7-42ff-ab12-67630bd26be5 req-99c363c6-5a4a-481a-9b68-4bbfe24150c7 service nova] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-768ed5e2-56e7-42ff-ab12-67630bd26be5 req-99c363c6-5a4a-481a-9b68-4bbfe24150c7 service nova] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-768ed5e2-56e7-42ff-ab12-67630bd26be5 req-99c363c6-5a4a-481a-9b68-4bbfe24150c7 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] No waiting events found dispatching network-vif-plugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:44 user nova-compute[70659]: WARNING nova.compute.manager [req-768ed5e2-56e7-42ff-ab12-67630bd26be5 req-99c363c6-5a4a-481a-9b68-4bbfe24150c7 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received unexpected event network-vif-plugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 for instance with vm_state building and task_state spawning.
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304384.808651, e006724d-e45a-405f-9084-544925aaa8ad => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:59:44 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] VM Resumed (Lifecycle Event)
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:59:44 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Instance spawned successfully.
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:59:44 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304384.8119042, e006724d-e45a-405f-9084-544925aaa8ad => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:59:44 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] VM Started (Lifecycle Event)
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:59:44 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:59:44 user nova-compute[70659]: INFO nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Took 6.41 seconds to spawn the instance on the hypervisor.
Jul 25 16:59:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:59:45 user nova-compute[70659]: INFO nova.compute.manager [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Took 7.24 seconds to build instance.
Jul 25 16:59:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-72ea7ff6-38e4-46ab-9599-6a5d8e7e793f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "e006724d-e45a-405f-9084-544925aaa8ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.351s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:59:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:59:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:53 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.423s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:57 user nova-compute[70659]: INFO nova.compute.manager [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Terminating instance
Jul 25 16:59:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.manager [req-e835123c-feda-4f3d-a592-08fa5b17f4ee req-a368693a-7f91-4ec3-a46a-c4c4cf30da47 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received event network-vif-unplugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e835123c-feda-4f3d-a592-08fa5b17f4ee req-a368693a-7f91-4ec3-a46a-c4c4cf30da47 service nova] Acquiring lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e835123c-feda-4f3d-a592-08fa5b17f4ee req-a368693a-7f91-4ec3-a46a-c4c4cf30da47 service nova] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e835123c-feda-4f3d-a592-08fa5b17f4ee req-a368693a-7f91-4ec3-a46a-c4c4cf30da47 service nova] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.manager [req-e835123c-feda-4f3d-a592-08fa5b17f4ee req-a368693a-7f91-4ec3-a46a-c4c4cf30da47 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] No waiting events found dispatching network-vif-unplugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.manager [req-e835123c-feda-4f3d-a592-08fa5b17f4ee req-a368693a-7f91-4ec3-a46a-c4c4cf30da47 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received event network-vif-unplugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:59:58 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:59:58 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7432MB free_disk=25.268299102783203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Instance destroyed successfully.
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lazy-loading 'resources' on Instance uuid f3dc2e56-b192-4e05-bb09-468d85f9cf75 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1358222157',display_name='tempest-ServersNegativeTestJSON-server-1358222157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1358222157',id=15,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:51:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c2a00920ce74688937a25cb3db3dd07',ramdisk_id='',reservation_id='r-3zy4ck2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1085604250',owner_user_name='tempest-ServersNegativeTestJSON-1085604250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:51:16Z,user_data=None,user_id='8c06f1babb164e4e9ae334ad5c81ab65',uuid=f3dc2e56-b192-4e05-bb09-468d85f9cf75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converting VIF {"id": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "address": "fa:16:3e:bd:a8:61", "network": {"id": "33330363-8ecb-40bd-9fcc-303c7f1e9d95", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-887962435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2a00920ce74688937a25cb3db3dd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73daa8f1-c8", "ovs_interfaceid": "73daa8f1-c8ee-437c-bf96-d17f57fa1611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:a8:61,bridge_name='br-int',has_traffic_filtering=True,id=73daa8f1-c8ee-437c-bf96-d17f57fa1611,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73daa8f1-c8') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG os_vif [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:a8:61,bridge_name='br-int',has_traffic_filtering=True,id=73daa8f1-c8ee-437c-bf96-d17f57fa1611,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73daa8f1-c8') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73daa8f1-c8, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:59:58 user nova-compute[70659]: INFO os_vif [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:a8:61,bridge_name='br-int',has_traffic_filtering=True,id=73daa8f1-c8ee-437c-bf96-d17f57fa1611,network=Network(33330363-8ecb-40bd-9fcc-303c7f1e9d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73daa8f1-c8')
Jul 25 16:59:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Deleting instance files /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75_del
Jul 25 16:59:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Deletion of /opt/stack/data/nova/instances/f3dc2e56-b192-4e05-bb09-468d85f9cf75_del complete
Jul 25 16:59:58 user nova-compute[70659]: INFO nova.compute.manager [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 25 16:59:58 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f6fba6f6-ff72-43c2-b824-f262bf430eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 51c336bc-e646-4429-809d-354ae03bd8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e3533a51-ce1c-4d49-9cef-49cc2ebbebed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e006724d-e45a-405f-9084-544925aaa8ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:59:58 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-6a17cc49-7cf0-4f1e-85c4-b1dd92836087 req-172fdc1d-886a-4f13-87e6-70ee7d569f37 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received event network-vif-deleted-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:59 user nova-compute[70659]: INFO nova.compute.manager [req-6a17cc49-7cf0-4f1e-85c4-b1dd92836087 req-172fdc1d-886a-4f13-87e6-70ee7d569f37 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Neutron deleted interface 73daa8f1-c8ee-437c-bf96-d17f57fa1611; detaching it from the instance and deleting it from the info cache
Jul 25 16:59:59 user nova-compute[70659]: DEBUG nova.network.neutron [req-6a17cc49-7cf0-4f1e-85c4-b1dd92836087 req-172fdc1d-886a-4f13-87e6-70ee7d569f37 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:59:59 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Took 0.85 seconds to deallocate network for instance.
Jul 25 16:59:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-6a17cc49-7cf0-4f1e-85c4-b1dd92836087 req-172fdc1d-886a-4f13-87e6-70ee7d569f37 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Detach interface failed, port_id=73daa8f1-c8ee-437c-bf96-d17f57fa1611, reason: Instance f3dc2e56-b192-4e05-bb09-468d85f9cf75 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-b639dcc5-42ae-4202-b396-d4609abf2771 req-7988f91d-d8f1-4d56-9746-78c8fd73f749 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received event network-vif-plugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b639dcc5-42ae-4202-b396-d4609abf2771 req-7988f91d-d8f1-4d56-9746-78c8fd73f749 service nova] Acquiring lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b639dcc5-42ae-4202-b396-d4609abf2771 req-7988f91d-d8f1-4d56-9746-78c8fd73f749 service nova] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b639dcc5-42ae-4202-b396-d4609abf2771 req-7988f91d-d8f1-4d56-9746-78c8fd73f749 service nova] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-b639dcc5-42ae-4202-b396-d4609abf2771 req-7988f91d-d8f1-4d56-9746-78c8fd73f749 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] No waiting events found dispatching network-vif-plugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:59:59 user nova-compute[70659]: WARNING nova.compute.manager [req-b639dcc5-42ae-4202-b396-d4609abf2771 req-7988f91d-d8f1-4d56-9746-78c8fd73f749 service nova] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Received unexpected event network-vif-plugged-73daa8f1-c8ee-437c-bf96-d17f57fa1611 for instance with vm_state deleted and task_state None.
Jul 25 16:59:59 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:59:59 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Deleted allocations for instance f3dc2e56-b192-4e05-bb09-468d85f9cf75
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:59:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:00:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c251296-ea20-4e04-bb84-19cbd1153cd8 tempest-ServersNegativeTestJSON-1085604250 tempest-ServersNegativeTestJSON-1085604250-project-member] Lock "f3dc2e56-b192-4e05-bb09-468d85f9cf75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.919s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:00:00 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:00:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:00:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:00:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:00:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:00:00 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updating instance_info_cache with network_info: [{"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:00:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:00:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:00:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:00:06 user nova-compute[70659]: INFO nova.compute.manager [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Terminating instance
Jul 25 17:00:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-02874713-ab0b-4f3b-82a1-989fb94d76f6 req-57a37a73-ea68-4134-ad9b-3e1b98e4da5b service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received event network-vif-unplugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02874713-ab0b-4f3b-82a1-989fb94d76f6 req-57a37a73-ea68-4134-ad9b-3e1b98e4da5b service nova] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02874713-ab0b-4f3b-82a1-989fb94d76f6 req-57a37a73-ea68-4134-ad9b-3e1b98e4da5b service nova] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02874713-ab0b-4f3b-82a1-989fb94d76f6 req-57a37a73-ea68-4134-ad9b-3e1b98e4da5b service nova] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-02874713-ab0b-4f3b-82a1-989fb94d76f6 req-57a37a73-ea68-4134-ad9b-3e1b98e4da5b service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] No waiting events found dispatching network-vif-unplugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:00:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-02874713-ab0b-4f3b-82a1-989fb94d76f6 req-57a37a73-ea68-4134-ad9b-3e1b98e4da5b service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received event network-vif-unplugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Instance destroyed successfully.
Jul 25 17:00:07 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lazy-loading 'resources' on Instance uuid f6fba6f6-ff72-43c2-b824-f262bf430eac {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1536461684',display_name='tempest-SnapshotDataIntegrityTests-server-1536461684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1536461684',id=19,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuVkZmNvixwDG6NLlmdU3M0sUwLZdteWs6RCK5Fxf5ZwQEXNlfutETo+f87tj3kW8XrpO4gZyzJenjbmp4H8eC3cYEVyul/uRuldYiM5e2VGRC729j4CoDBBUaQFgltvg==',key_name='tempest-keypair-1247728674',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='725c777c803f4e88ba9ab61087cdd31e',ramdisk_id='',reservation_id='r-mz0jj0ue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-388486524',owner_user_name='tempest-SnapshotDataIntegrityTests-388486524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:53:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f464245ee7be409e8dee782665392b6c',uuid=f6fba6f6-ff72-43c2-b824-f262bf430eac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Converting VIF {"id": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "address": "fa:16:3e:56:91:c8", "network": {"id": "502ae5ae-02dd-4f97-8c49-0de37e938a26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1290023072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "725c777c803f4e88ba9ab61087cdd31e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7350aa2e-c1", "ovs_interfaceid": "7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:91:c8,bridge_name='br-int',has_traffic_filtering=True,id=7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c,network=Network(502ae5ae-02dd-4f97-8c49-0de37e938a26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7350aa2e-c1') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG os_vif [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:91:c8,bridge_name='br-int',has_traffic_filtering=True,id=7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c,network=Network(502ae5ae-02dd-4f97-8c49-0de37e938a26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7350aa2e-c1') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7350aa2e-c1, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:00:07 user nova-compute[70659]: INFO os_vif [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:91:c8,bridge_name='br-int',has_traffic_filtering=True,id=7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c,network=Network(502ae5ae-02dd-4f97-8c49-0de37e938a26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7350aa2e-c1')
Jul 25 17:00:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Deleting instance files /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac_del
Jul 25 17:00:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Deletion of /opt/stack/data/nova/instances/f6fba6f6-ff72-43c2-b824-f262bf430eac_del complete
Jul 25 17:00:07 user nova-compute[70659]: INFO nova.compute.manager [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Took 1.47 seconds to destroy the instance on the hypervisor.
Jul 25 17:00:07 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:00:07 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:00:08 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:00:08 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Took 1.01 seconds to deallocate network for instance.
Jul 25 17:00:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:00:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:00:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-8beab095-9aed-40e5-8401-8d059803dd01 req-5b29635a-e736-4693-9bcf-03b01410b63b service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received event network-vif-plugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:00:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8beab095-9aed-40e5-8401-8d059803dd01 req-5b29635a-e736-4693-9bcf-03b01410b63b service nova] Acquiring lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:00:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8beab095-9aed-40e5-8401-8d059803dd01 req-5b29635a-e736-4693-9bcf-03b01410b63b service nova] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:00:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8beab095-9aed-40e5-8401-8d059803dd01 req-5b29635a-e736-4693-9bcf-03b01410b63b service nova] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:00:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-8beab095-9aed-40e5-8401-8d059803dd01 req-5b29635a-e736-4693-9bcf-03b01410b63b service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] No waiting events found dispatching network-vif-plugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:00:08 user nova-compute[70659]: WARNING nova.compute.manager [req-8beab095-9aed-40e5-8401-8d059803dd01 req-5b29635a-e736-4693-9bcf-03b01410b63b service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received unexpected event network-vif-plugged-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c for instance with vm_state deleted and task_state None.
Jul 25 17:00:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-8beab095-9aed-40e5-8401-8d059803dd01 req-5b29635a-e736-4693-9bcf-03b01410b63b service nova] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Received event network-vif-deleted-7350aa2e-c1ac-429e-bcd3-a1bfe46bea5c {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:00:09 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:00:09 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:00:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:00:09 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Deleted allocations for instance f6fba6f6-ff72-43c2-b824-f262bf430eac
Jul 25 17:00:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9b45ca88-d928-46b1-819e-ea42092b4fb9 tempest-SnapshotDataIntegrityTests-388486524 tempest-SnapshotDataIntegrityTests-388486524-project-member] Lock "f6fba6f6-ff72-43c2-b824-f262bf430eac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.089s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:00:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:13 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304397.8027601, f3dc2e56-b192-4e05-bb09-468d85f9cf75 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:00:13 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] VM Stopped (Lifecycle Event)
Jul 25 17:00:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7be99dcd-49fc-44cb-9fbe-bee073cca0db None None] [instance: f3dc2e56-b192-4e05-bb09-468d85f9cf75] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:00:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-a21f91d4-8cf8-4f92-94e1-47ad921a9547 req-63715b75-739c-481c-b949-0ad853ace7dc service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-changed-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:00:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-a21f91d4-8cf8-4f92-94e1-47ad921a9547 req-63715b75-739c-481c-b949-0ad853ace7dc service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Refreshing instance network info cache due to event network-changed-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:00:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a21f91d4-8cf8-4f92-94e1-47ad921a9547 req-63715b75-739c-481c-b949-0ad853ace7dc service nova] Acquiring lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:00:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a21f91d4-8cf8-4f92-94e1-47ad921a9547 req-63715b75-739c-481c-b949-0ad853ace7dc service nova] Acquired lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:00:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-a21f91d4-8cf8-4f92-94e1-47ad921a9547 req-63715b75-739c-481c-b949-0ad853ace7dc service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Refreshing network info cache for port 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:00:16 user nova-compute[70659]: INFO nova.compute.manager [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Detaching volume 13d82a96-71af-43cd-ad85-419373af6b27
Jul 25 17:00:16 user nova-compute[70659]: INFO nova.virt.block_device [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Attempting to driver detach volume 13d82a96-71af-43cd-ad85-419373af6b27 from mountpoint /dev/vdb
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Attempting to detach device vdb from instance 51c336bc-e646-4429-809d-354ae03bd8d6 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:00:16 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:00:16 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 17:00:16 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:00:16 user nova-compute[70659]:   <serial>13d82a96-71af-43cd-ad85-419373af6b27</serial>
Jul 25 17:00:16 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:00:16 user nova-compute[70659]: </disk>
Jul 25 17:00:16 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:00:16 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Successfully detached device vdb from instance 51c336bc-e646-4429-809d-354ae03bd8d6 from the persistent domain config.
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51c336bc-e646-4429-809d-354ae03bd8d6 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:00:16 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:00:16 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 17:00:16 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:00:16 user nova-compute[70659]:   <serial>13d82a96-71af-43cd-ad85-419373af6b27</serial>
Jul 25 17:00:16 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:00:16 user nova-compute[70659]: </disk>
Jul 25 17:00:16 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-a21f91d4-8cf8-4f92-94e1-47ad921a9547 req-63715b75-739c-481c-b949-0ad853ace7dc service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updated VIF entry in instance network info cache for port 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-a21f91d4-8cf8-4f92-94e1-47ad921a9547 req-63715b75-739c-481c-b949-0ad853ace7dc service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating instance_info_cache with network_info: [{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a21f91d4-8cf8-4f92-94e1-47ad921a9547 req-63715b75-739c-481c-b949-0ad853ace7dc service nova] Releasing lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304416.5981274, 51c336bc-e646-4429-809d-354ae03bd8d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:00:16 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Successfully detached device vdb from instance 51c336bc-e646-4429-809d-354ae03bd8d6 from the live domain config.
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqcRZtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:00:16 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84ebf7e-6735-401f-9696-de01ed4979c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcaaf91-564f-44a1-a4a5-bfc9081eaf31]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:00:16 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 17:00:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:00:16 user nova-compute[70659]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 (non-flash)
Jul 25 17:00:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd28282050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27'): ({'sdd'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Removing single pathed devices sdd {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fd8e75-c15c-4edd-bab8-0248791eccdc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa949e6a-dd22-41c1-98d5-4997b79a35dc]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Flushing IO for device /dev/sdd {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2d7808-8d3c-4297-a8e1-6924069ae1a4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3813f2-321f-4a9f-93ea-de2460823298]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a45e58-7605-4582-be76-bae6916426a9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb1cf9e-a555-4fbf-b0ac-1a86bcdd0975]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27, portal: 172.16.0.220,3260]
Jul 25 17:00:16 user nova-compute[70659]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27, portal: 172.16.0.220,3260] successful.
Jul 25 17:00:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13d82a96-71af-43cd-ad85-419373af6b27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86fa91b-821d-401e-88a3-9e243d06cf62]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] <== disconnect_volume: return (281ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:00:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:00:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-8b3cf48c-26a3-4655-a332-f5a99a94884c req-7bd4221a-8ec1-4a9b-bf55-9dc5a943faed service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-changed-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:00:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-8b3cf48c-26a3-4655-a332-f5a99a94884c req-7bd4221a-8ec1-4a9b-bf55-9dc5a943faed service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Refreshing instance network info cache due to event network-changed-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:00:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8b3cf48c-26a3-4655-a332-f5a99a94884c req-7bd4221a-8ec1-4a9b-bf55-9dc5a943faed service nova] Acquiring lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:00:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8b3cf48c-26a3-4655-a332-f5a99a94884c req-7bd4221a-8ec1-4a9b-bf55-9dc5a943faed service nova] Acquired lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:00:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-8b3cf48c-26a3-4655-a332-f5a99a94884c req-7bd4221a-8ec1-4a9b-bf55-9dc5a943faed service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Refreshing network info cache for port 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:00:18 user nova-compute[70659]: DEBUG nova.network.neutron [req-8b3cf48c-26a3-4655-a332-f5a99a94884c req-7bd4221a-8ec1-4a9b-bf55-9dc5a943faed service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updated VIF entry in instance network info cache for port 5eb397f0-b9a0-4bb7-a2e7-47b497485cf2. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:00:18 user nova-compute[70659]: DEBUG nova.network.neutron [req-8b3cf48c-26a3-4655-a332-f5a99a94884c req-7bd4221a-8ec1-4a9b-bf55-9dc5a943faed service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating instance_info_cache with network_info: [{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:00:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8b3cf48c-26a3-4655-a332-f5a99a94884c req-7bd4221a-8ec1-4a9b-bf55-9dc5a943faed service nova] Releasing lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:00:20 user nova-compute[70659]: DEBUG nova.objects.instance [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'flavor' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:00:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eecd4b16-d607-46a2-95b6-be9389cfb7ec tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.710s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:00:22 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304407.1177506, f6fba6f6-ff72-43c2-b824-f262bf430eac => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:00:22 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] VM Stopped (Lifecycle Event)
Jul 25 17:00:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c4c2db34-f046-452a-9625-ecad8b1853b4 None None] [instance: f6fba6f6-ff72-43c2-b824-f262bf430eac] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:00:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:00:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:00:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-cc03f3b7-8e7b-41b5-90bd-4dc2a1250388 req-cfee55b8-c829-4214-b704-dba667d6d719 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-changed-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:00:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-cc03f3b7-8e7b-41b5-90bd-4dc2a1250388 req-cfee55b8-c829-4214-b704-dba667d6d719 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Refreshing instance network info cache due to event network-changed-2522dddf-d653-4f79-9db4-4785f9566253. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:00:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cc03f3b7-8e7b-41b5-90bd-4dc2a1250388 req-cfee55b8-c829-4214-b704-dba667d6d719 service nova] Acquiring lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:00:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cc03f3b7-8e7b-41b5-90bd-4dc2a1250388 req-cfee55b8-c829-4214-b704-dba667d6d719 service nova] Acquired lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:00:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-cc03f3b7-8e7b-41b5-90bd-4dc2a1250388 req-cfee55b8-c829-4214-b704-dba667d6d719 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Refreshing network info cache for port 2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:00:39 user nova-compute[70659]: DEBUG nova.network.neutron [req-cc03f3b7-8e7b-41b5-90bd-4dc2a1250388 req-cfee55b8-c829-4214-b704-dba667d6d719 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updated VIF entry in instance network info cache for port 2522dddf-d653-4f79-9db4-4785f9566253. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:00:39 user nova-compute[70659]: DEBUG nova.network.neutron [req-cc03f3b7-8e7b-41b5-90bd-4dc2a1250388 req-cfee55b8-c829-4214-b704-dba667d6d719 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating instance_info_cache with network_info: [{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:00:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cc03f3b7-8e7b-41b5-90bd-4dc2a1250388 req-cfee55b8-c829-4214-b704-dba667d6d719 service nova] Releasing lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:00:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:49 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:00:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:53 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:00:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:00:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:00:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:00:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:55 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:00:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:00:58 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:00:58 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7856MB free_disk=25.25359344482422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 51c336bc-e646-4429-809d-354ae03bd8d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e3533a51-ce1c-4d49-9cef-49cc2ebbebed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e006724d-e45a-405f-9084-544925aaa8ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:00:58 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:00:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:00:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:00:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:01:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:01:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:01:02 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating instance_info_cache with network_info: [{"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-51c336bc-e646-4429-809d-354ae03bd8d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:01:03 user nova-compute[70659]: INFO nova.compute.claims [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Claim successful on node user
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.network.neutron [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:01:03 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:01:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG nova.policy [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e925fbb88b3e433abd27fa08a766e4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ed4eae8755454c9e5be953e69c013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:01:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Creating image(s)
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "/opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "/opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "/opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk 1073741824" returned: 0 in 0.054s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Successfully created port: 2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Cannot resize image /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'migration_context' on Instance uuid 77750821-16ee-4945-88ff-a8445edab24b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Ensure instance console log exists: /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Successfully updated port: 2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "refresh_cache-77750821-16ee-4945-88ff-a8445edab24b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquired lock "refresh_cache-77750821-16ee-4945-88ff-a8445edab24b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-f9d3614b-ba3c-4111-8d54-a04b93ba4f98 req-70cc0ef2-b432-4069-97b8-a334010cad6b service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received event network-changed-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-f9d3614b-ba3c-4111-8d54-a04b93ba4f98 req-70cc0ef2-b432-4069-97b8-a334010cad6b service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Refreshing instance network info cache due to event network-changed-2c6378e0-e987-4aeb-93e7-d8ee73aead01. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9d3614b-ba3c-4111-8d54-a04b93ba4f98 req-70cc0ef2-b432-4069-97b8-a334010cad6b service nova] Acquiring lock "refresh_cache-77750821-16ee-4945-88ff-a8445edab24b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Updating instance_info_cache with network_info: [{"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Releasing lock "refresh_cache-77750821-16ee-4945-88ff-a8445edab24b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Instance network_info: |[{"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9d3614b-ba3c-4111-8d54-a04b93ba4f98 req-70cc0ef2-b432-4069-97b8-a334010cad6b service nova] Acquired lock "refresh_cache-77750821-16ee-4945-88ff-a8445edab24b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.network.neutron [req-f9d3614b-ba3c-4111-8d54-a04b93ba4f98 req-70cc0ef2-b432-4069-97b8-a334010cad6b service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Refreshing network info cache for port 2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Start _get_guest_xml network_info=[{"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:01:05 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:01:05 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1645951941',display_name='tempest-AttachVolumeNegativeTest-server-1645951941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1645951941',id=32,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfKz2QfldCQ7KV3nou0/5ibHe4YwqsJp8Gvw+THphFYUzkk4PViFhVIO8WEh1bZxkibqFwQ+iazBeMi/+cJA443sE5Km6CpVpFaro8bE8dtzdBevOHR0iFS9SIGLXFr0A==',key_name='tempest-keypair-1819778944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-25g77lzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=77750821-16ee-4945-88ff-a8445edab24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=2c6378e0-e987-4aeb-93e7-d8ee73aead01,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6378e0-e9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:01:05 user nova-compute[70659]: DEBUG nova.objects.instance [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'pci_devices' on Instance uuid 77750821-16ee-4945-88ff-a8445edab24b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:01:06 user nova-compute[70659]:   <uuid>77750821-16ee-4945-88ff-a8445edab24b</uuid>
Jul 25 17:01:06 user nova-compute[70659]:   <name>instance-00000020</name>
Jul 25 17:01:06 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:01:06 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:01:06 user nova-compute[70659]:   <metadata>
Jul 25 17:01:06 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:01:06 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:01:06 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1645951941</nova:name>
Jul 25 17:01:06 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:01:05</nova:creationTime>
Jul 25 17:01:06 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:01:06 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:01:06 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:01:06 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:01:06 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:01:06 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:01:06 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:01:06 user nova-compute[70659]:       <nova:owner>
Jul 25 17:01:06 user nova-compute[70659]:         <nova:user uuid="e925fbb88b3e433abd27fa08a766e4e8">tempest-AttachVolumeNegativeTest-921778031-project-member</nova:user>
Jul 25 17:01:06 user nova-compute[70659]:         <nova:project uuid="e5ed4eae8755454c9e5be953e69c013a">tempest-AttachVolumeNegativeTest-921778031</nova:project>
Jul 25 17:01:06 user nova-compute[70659]:       </nova:owner>
Jul 25 17:01:06 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:01:06 user nova-compute[70659]:       <nova:ports>
Jul 25 17:01:06 user nova-compute[70659]:         <nova:port uuid="2c6378e0-e987-4aeb-93e7-d8ee73aead01">
Jul 25 17:01:06 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 17:01:06 user nova-compute[70659]:         </nova:port>
Jul 25 17:01:06 user nova-compute[70659]:       </nova:ports>
Jul 25 17:01:06 user nova-compute[70659]:     </nova:instance>
Jul 25 17:01:06 user nova-compute[70659]:   </metadata>
Jul 25 17:01:06 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:01:06 user nova-compute[70659]:     <system>
Jul 25 17:01:06 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:01:06 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:01:06 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:01:06 user nova-compute[70659]:       <entry name="serial">77750821-16ee-4945-88ff-a8445edab24b</entry>
Jul 25 17:01:06 user nova-compute[70659]:       <entry name="uuid">77750821-16ee-4945-88ff-a8445edab24b</entry>
Jul 25 17:01:06 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:01:06 user nova-compute[70659]:     </system>
Jul 25 17:01:06 user nova-compute[70659]:   </sysinfo>
Jul 25 17:01:06 user nova-compute[70659]:   <os>
Jul 25 17:01:06 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:01:06 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:01:06 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:01:06 user nova-compute[70659]:   </os>
Jul 25 17:01:06 user nova-compute[70659]:   <features>
Jul 25 17:01:06 user nova-compute[70659]:     <acpi/>
Jul 25 17:01:06 user nova-compute[70659]:     <apic/>
Jul 25 17:01:06 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:01:06 user nova-compute[70659]:   </features>
Jul 25 17:01:06 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:01:06 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:01:06 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:01:06 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:01:06 user nova-compute[70659]:   </clock>
Jul 25 17:01:06 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:01:06 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:01:06 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:01:06 user nova-compute[70659]:   </cpu>
Jul 25 17:01:06 user nova-compute[70659]:   <devices>
Jul 25 17:01:06 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:01:06 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:01:06 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk"/>
Jul 25 17:01:06 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:01:06 user nova-compute[70659]:     </disk>
Jul 25 17:01:06 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:01:06 user nova-compute[70659]:       <mac address="fa:16:3e:6a:fb:de"/>
Jul 25 17:01:06 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:01:06 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:01:06 user nova-compute[70659]:       <target dev="tap2c6378e0-e9"/>
Jul 25 17:01:06 user nova-compute[70659]:     </interface>
Jul 25 17:01:06 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:01:06 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/console.log" append="off"/>
Jul 25 17:01:06 user nova-compute[70659]:     </serial>
Jul 25 17:01:06 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:01:06 user nova-compute[70659]:     <video>
Jul 25 17:01:06 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:01:06 user nova-compute[70659]:     </video>
Jul 25 17:01:06 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:01:06 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:01:06 user nova-compute[70659]:     </rng>
Jul 25 17:01:06 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:01:06 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:01:06 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:01:06 user nova-compute[70659]:     </memballoon>
Jul 25 17:01:06 user nova-compute[70659]:   </devices>
Jul 25 17:01:06 user nova-compute[70659]: </domain>
Jul 25 17:01:06 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1645951941',display_name='tempest-AttachVolumeNegativeTest-server-1645951941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1645951941',id=32,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfKz2QfldCQ7KV3nou0/5ibHe4YwqsJp8Gvw+THphFYUzkk4PViFhVIO8WEh1bZxkibqFwQ+iazBeMi/+cJA443sE5Km6CpVpFaro8bE8dtzdBevOHR0iFS9SIGLXFr0A==',key_name='tempest-keypair-1819778944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-25g77lzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=77750821-16ee-4945-88ff-a8445edab24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=2c6378e0-e987-4aeb-93e7-d8ee73aead01,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6378e0-e9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG os_vif [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=2c6378e0-e987-4aeb-93e7-d8ee73aead01,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6378e0-e9') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c6378e0-e9, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c6378e0-e9, col_values=(('external_ids', {'iface-id': '2c6378e0-e987-4aeb-93e7-d8ee73aead01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:fb:de', 'vm-uuid': '77750821-16ee-4945-88ff-a8445edab24b'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:06 user nova-compute[70659]: INFO os_vif [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=2c6378e0-e987-4aeb-93e7-d8ee73aead01,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6378e0-e9')
Jul 25 17:01:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No VIF found with MAC fa:16:3e:6a:fb:de, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-f9d3614b-ba3c-4111-8d54-a04b93ba4f98 req-70cc0ef2-b432-4069-97b8-a334010cad6b service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Updated VIF entry in instance network info cache for port 2c6378e0-e987-4aeb-93e7-d8ee73aead01. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG nova.network.neutron [req-f9d3614b-ba3c-4111-8d54-a04b93ba4f98 req-70cc0ef2-b432-4069-97b8-a334010cad6b service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Updating instance_info_cache with network_info: [{"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9d3614b-ba3c-4111-8d54-a04b93ba4f98 req-70cc0ef2-b432-4069-97b8-a334010cad6b service nova] Releasing lock "refresh_cache-77750821-16ee-4945-88ff-a8445edab24b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:06 user nova-compute[70659]: INFO nova.compute.manager [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Terminating instance
Jul 25 17:01:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-15d8fbfd-39a4-4503-9c27-76c421702dff req-a8a831ea-b6de-4053-8af9-5374c385e56e service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-15d8fbfd-39a4-4503-9c27-76c421702dff req-a8a831ea-b6de-4053-8af9-5374c385e56e service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-15d8fbfd-39a4-4503-9c27-76c421702dff req-a8a831ea-b6de-4053-8af9-5374c385e56e service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-15d8fbfd-39a4-4503-9c27-76c421702dff req-a8a831ea-b6de-4053-8af9-5374c385e56e service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-15d8fbfd-39a4-4503-9c27-76c421702dff req-a8a831ea-b6de-4053-8af9-5374c385e56e service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-15d8fbfd-39a4-4503-9c27-76c421702dff req-a8a831ea-b6de-4053-8af9-5374c385e56e service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-unplugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Instance destroyed successfully.
Jul 25 17:01:07 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'resources' on Instance uuid 51c336bc-e646-4429-809d-354ae03bd8d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1644944333',display_name='tempest-ServerRescueNegativeTestJSON-server-1644944333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1644944333',id=23,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4jhIgOnxMQ5hodwDxhkvFAV/jzlx2MOi4HvSNeJhJQiQaz+EGM3gY5tYAvVpFFq2DgsXfMEUphY9/W2Cum8qMezySKtcW3KY6sqG6Ms5RpptV/IsBe9BWa/fEzK7lIfg==',key_name='tempest-keypair-1807504337',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-ihgike6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:58:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=51c336bc-e646-4429-809d-354ae03bd8d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "address": "fa:16:3e:e1:da:ad", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eb397f0-b9", "ovs_interfaceid": "5eb397f0-b9a0-4bb7-a2e7-47b497485cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:da:ad,bridge_name='br-int',has_traffic_filtering=True,id=5eb397f0-b9a0-4bb7-a2e7-47b497485cf2,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eb397f0-b9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG os_vif [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:da:ad,bridge_name='br-int',has_traffic_filtering=True,id=5eb397f0-b9a0-4bb7-a2e7-47b497485cf2,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eb397f0-b9') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5eb397f0-b9, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:07 user nova-compute[70659]: INFO os_vif [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:da:ad,bridge_name='br-int',has_traffic_filtering=True,id=5eb397f0-b9a0-4bb7-a2e7-47b497485cf2,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eb397f0-b9')
Jul 25 17:01:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Deleting instance files /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6_del
Jul 25 17:01:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Deletion of /opt/stack/data/nova/instances/51c336bc-e646-4429-809d-354ae03bd8d6_del complete
Jul 25 17:01:07 user nova-compute[70659]: INFO nova.compute.manager [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Took 1.59 seconds to destroy the instance on the hypervisor.
Jul 25 17:01:07 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:01:07 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:01:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:01:09 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Took 1.16 seconds to deallocate network for instance.
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] Acquiring lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] Lock "51c336bc-e646-4429-809d-354ae03bd8d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] No waiting events found dispatching network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:01:09 user nova-compute[70659]: WARNING nova.compute.manager [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received unexpected event network-vif-plugged-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 for instance with vm_state active and task_state deleting.
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received event network-vif-plugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] No waiting events found dispatching network-vif-plugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:01:09 user nova-compute[70659]: WARNING nova.compute.manager [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received unexpected event network-vif-plugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 for instance with vm_state building and task_state spawning.
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received event network-vif-plugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] No waiting events found dispatching network-vif-plugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:01:09 user nova-compute[70659]: WARNING nova.compute.manager [req-fd7996df-306b-44d8-abc5-f554a85f3cc2 req-fcd70d15-aee9-4d53-a1a7-7c8d569d6828 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received unexpected event network-vif-plugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 for instance with vm_state building and task_state spawning.
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-bcd6a925-943e-4323-a3c5-1b95bd900ca7 req-607f4674-aa55-435d-90b2-d955aafecbf2 service nova] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Received event network-vif-deleted-5eb397f0-b9a0-4bb7-a2e7-47b497485cf2 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:09 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Deleted allocations for instance 51c336bc-e646-4429-809d-354ae03bd8d6
Jul 25 17:01:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c3b071e-f5f4-429c-862a-8d87e93fb459 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "51c336bc-e646-4429-809d-354ae03bd8d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.322s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304470.5658755, 77750821-16ee-4945-88ff-a8445edab24b => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:01:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 77750821-16ee-4945-88ff-a8445edab24b] VM Resumed (Lifecycle Event)
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:01:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Instance spawned successfully.
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 77750821-16ee-4945-88ff-a8445edab24b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304470.568133, 77750821-16ee-4945-88ff-a8445edab24b => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:01:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 77750821-16ee-4945-88ff-a8445edab24b] VM Started (Lifecycle Event)
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:01:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 77750821-16ee-4945-88ff-a8445edab24b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:01:10 user nova-compute[70659]: INFO nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Took 6.66 seconds to spawn the instance on the hypervisor.
Jul 25 17:01:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:01:10 user nova-compute[70659]: INFO nova.compute.manager [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Took 7.58 seconds to build instance.
Jul 25 17:01:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-797b92c1-025a-4801-81f4-b0dbca84c05c tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.695s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:01:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:01:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:01:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:01:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:22 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304467.7850192, 51c336bc-e646-4429-809d-354ae03bd8d6 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:01:22 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] VM Stopped (Lifecycle Event)
Jul 25 17:01:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-64215a7d-e3ea-4d0b-b98c-7fce4970be83 None None] [instance: 51c336bc-e646-4429-809d-354ae03bd8d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:01:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-8dc6b6c8-7b20-4a6c-bbd0-0b6a8c671f70 req-d84e0f27-f458-4880-a6f2-9785474f5da1 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received event network-changed-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-8dc6b6c8-7b20-4a6c-bbd0-0b6a8c671f70 req-d84e0f27-f458-4880-a6f2-9785474f5da1 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Refreshing instance network info cache due to event network-changed-96a5fb5e-fdd6-48d7-8340-2bf58b72be56. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8dc6b6c8-7b20-4a6c-bbd0-0b6a8c671f70 req-d84e0f27-f458-4880-a6f2-9785474f5da1 service nova] Acquiring lock "refresh_cache-e3533a51-ce1c-4d49-9cef-49cc2ebbebed" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8dc6b6c8-7b20-4a6c-bbd0-0b6a8c671f70 req-d84e0f27-f458-4880-a6f2-9785474f5da1 service nova] Acquired lock "refresh_cache-e3533a51-ce1c-4d49-9cef-49cc2ebbebed" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-8dc6b6c8-7b20-4a6c-bbd0-0b6a8c671f70 req-d84e0f27-f458-4880-a6f2-9785474f5da1 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Refreshing network info cache for port 96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG nova.objects.instance [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'flavor' on Instance uuid e3533a51-ce1c-4d49-9cef-49cc2ebbebed {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:01:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Ignoring supplied device name: /dev/vdb
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:24 user nova-compute[70659]: INFO nova.compute.manager [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Attaching volume 4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f to /dev/vdb
Jul 25 17:01:24 user nova-compute[70659]: DEBUG os_brick.utils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.035s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[944cbe9b-a504-45a2-a834-0b3c9912d929]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2cda94-7e0f-436a-812b-314ec90e968e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.085s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a71881-b62e-4056-a005-e20893583b21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfa8bd1-2ec8-45ea-b770-a2b2a60004d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-8dc6b6c8-7b20-4a6c-bbd0-0b6a8c671f70 req-d84e0f27-f458-4880-a6f2-9785474f5da1 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Updated VIF entry in instance network info cache for port 96a5fb5e-fdd6-48d7-8340-2bf58b72be56. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-8dc6b6c8-7b20-4a6c-bbd0-0b6a8c671f70 req-d84e0f27-f458-4880-a6f2-9785474f5da1 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Updating instance_info_cache with network_info: [{"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8dc6b6c8-7b20-4a6c-bbd0-0b6a8c671f70 req-d84e0f27-f458-4880-a6f2-9785474f5da1 service nova] Releasing lock "refresh_cache-e3533a51-ce1c-4d49-9cef-49cc2ebbebed" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:01:24 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:01:24 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7110241-ecff-4582-8f8f-c83b4173b4df]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG os_brick.utils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] <== get_connector_properties: return (269ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:01:24 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Updating existing volume attachment record: 54ecdd53-241c-4c11-9474-8a592857d987 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:01:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:01:29 user nova-compute[70659]: INFO nova.compute.manager [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] instance snapshotting
Jul 25 17:01:29 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Beginning live snapshot process
Jul 25 17:01:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json -f qcow2 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json -f qcow2 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.171s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1jbk4zmj/e82e7f2001dc439c8f5dc08aa07fc554.delta 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1jbk4zmj/e82e7f2001dc439c8f5dc08aa07fc554.delta 1073741824" returned: 0 in 0.062s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 17:01:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 17:01:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] COPY block job progress, current cursor: 22806528 final cursor: 75497472 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 17:01:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 17:01:32 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 17:01:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:32 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 17:01:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1jbk4zmj/e82e7f2001dc439c8f5dc08aa07fc554.delta /opt/stack/data/nova/instances/snapshots/tmp1jbk4zmj/e82e7f2001dc439c8f5dc08aa07fc554 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1jbk4zmj/e82e7f2001dc439c8f5dc08aa07fc554.delta /opt/stack/data/nova/instances/snapshots/tmp1jbk4zmj/e82e7f2001dc439c8f5dc08aa07fc554" returned: 0 in 0.691s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:32 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Snapshot extracted, beginning image upload
Jul 25 17:01:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Snapshot image upload complete
Jul 25 17:01:35 user nova-compute[70659]: INFO nova.compute.manager [None req-3d62c290-d846-4374-ac5a-e50f24fe651e tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Took 6.10 seconds to snapshot the instance on the hypervisor.
Jul 25 17:01:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZzkYyro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:01:38 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:01:38 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:01:38 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e398f920-d3a4-4af0-8095-a819bbdef1be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:01:38 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5fbbeb-98fa-421f-8f85-40a87504e5fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f] added
Jul 25 17:01:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf1741b-1563-4854-942f-97cc4c779d40]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10f9438-3950-40c9-833b-c5d20e24c06b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZzkYyro {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZzkYyro" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f6fa38-3301-4ace-8a18-a6b4b4aa1b8c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZzkYyro'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f19c34-20df-4231-8773-fd1bc1b89f46]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0538262b-40f4-4686-bcac-9a3b23daf472]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:01:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:01:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a492b119-d75b-4eef-a070-df492237c67e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f, portal: 172.16.0.220,3260]
Jul 25 17:01:38 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f, portal: 172.16.0.220,3260] successful.
Jul 25 17:01:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3e0b08-289d-4eb9-99dc-6a3f7de1aae9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[23825ebc-27f5-4e01-b91e-f8629841c198]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:01:38 user nova-compute[70659]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f (non-flash)
Jul 25 17:01:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:01:38 user nova-compute[70659]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f (non-flash)
Jul 25 17:01:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[167af5dd-7533-4a34-a412-b4e1950f37d2]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:01:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZzkYyro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:01:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:01:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23662353634306366', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:01:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662353634306366', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG nova.objects.instance [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'flavor' on Instance uuid e3533a51-ce1c-4d49-9cef-49cc2ebbebed {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:01:40 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:01:40 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:01:40 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:01:40 user nova-compute[70659]:   <serial>4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f</serial>
Jul 25 17:01:40 user nova-compute[70659]: </disk>
Jul 25 17:01:40 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] No VIF found with MAC fa:16:3e:b1:41:14, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46a67e9d-5cfa-4814-8f8b-8e94790ec615 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.278s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:40 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:01:40 user nova-compute[70659]: INFO nova.compute.claims [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Claim successful on node user
Jul 25 17:01:41 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:01:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:01:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG nova.policy [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1132e5daf391490f9440756cf9b2c9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5a2d8f3a548c7b7a2bd1747b253c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:01:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Creating image(s)
Jul 25 17:01:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "/opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "/opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.154s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.156s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk 1073741824" returned: 0 in 0.051s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Successfully created port: c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Cannot resize image /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lazy-loading 'migration_context' on Instance uuid 6bad1ca0-56cf-4a8d-b86c-adb41383e656 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Ensure instance console log exists: /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Successfully updated port: c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "refresh_cache-6bad1ca0-56cf-4a8d-b86c-adb41383e656" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquired lock "refresh_cache-6bad1ca0-56cf-4a8d-b86c-adb41383e656" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-981d48e5-c515-4216-ac36-975d03b06283 req-de8de7c9-3060-4943-a8e2-e976ab0ed98a service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received event network-changed-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-981d48e5-c515-4216-ac36-975d03b06283 req-de8de7c9-3060-4943-a8e2-e976ab0ed98a service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Refreshing instance network info cache due to event network-changed-c3f11e4b-8894-4a84-a443-7f77a930fcc6. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-981d48e5-c515-4216-ac36-975d03b06283 req-de8de7c9-3060-4943-a8e2-e976ab0ed98a service nova] Acquiring lock "refresh_cache-6bad1ca0-56cf-4a8d-b86c-adb41383e656" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Updating instance_info_cache with network_info: [{"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Releasing lock "refresh_cache-6bad1ca0-56cf-4a8d-b86c-adb41383e656" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Instance network_info: |[{"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-981d48e5-c515-4216-ac36-975d03b06283 req-de8de7c9-3060-4943-a8e2-e976ab0ed98a service nova] Acquired lock "refresh_cache-6bad1ca0-56cf-4a8d-b86c-adb41383e656" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.network.neutron [req-981d48e5-c515-4216-ac36-975d03b06283 req-de8de7c9-3060-4943-a8e2-e976ab0ed98a service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Refreshing network info cache for port c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Start _get_guest_xml network_info=[{"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:01:43 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:01:43 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:01:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1156147027',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1156147027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1156147',id=33,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/dwcQId82y6EOytzqb7leDM+gjPq1jKwdf34bv7rbxXsvKS+wfDxA61BnCELnAEjbBzGL6MEORSUMqamTGtdRO7ArwZgmIRjCFKHCjJbWrW81rNaS0A1yeXyFRwC8DFg==',key_name='tempest-keypair-711783819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fa5a2d8f3a548c7b7a2bd1747b253c3',ramdisk_id='',reservation_id='r-monww7gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1359034296',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:01:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1132e5daf391490f9440756cf9b2c9ca',uuid=6bad1ca0-56cf-4a8d-b86c-adb41383e656,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Converting VIF {"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:64:14,bridge_name='br-int',has_traffic_filtering=True,id=c3f11e4b-8894-4a84-a443-7f77a930fcc6,network=Network(0a5db3a9-b6e0-4750-9d90-12fba2fa119d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f11e4b-88') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bad1ca0-56cf-4a8d-b86c-adb41383e656 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:01:43 user nova-compute[70659]:   <uuid>6bad1ca0-56cf-4a8d-b86c-adb41383e656</uuid>
Jul 25 17:01:43 user nova-compute[70659]:   <name>instance-00000021</name>
Jul 25 17:01:43 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:01:43 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:01:43 user nova-compute[70659]:   <metadata>
Jul 25 17:01:43 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:01:43 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:01:43 user nova-compute[70659]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1156147027</nova:name>
Jul 25 17:01:43 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:01:43</nova:creationTime>
Jul 25 17:01:43 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:01:43 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:01:43 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:01:43 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:01:43 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:01:43 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:01:43 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:01:43 user nova-compute[70659]:       <nova:owner>
Jul 25 17:01:43 user nova-compute[70659]:         <nova:user uuid="1132e5daf391490f9440756cf9b2c9ca">tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member</nova:user>
Jul 25 17:01:43 user nova-compute[70659]:         <nova:project uuid="2fa5a2d8f3a548c7b7a2bd1747b253c3">tempest-TestServerVolumeAttachScenarioOldVersion-1359034296</nova:project>
Jul 25 17:01:43 user nova-compute[70659]:       </nova:owner>
Jul 25 17:01:43 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:01:43 user nova-compute[70659]:       <nova:ports>
Jul 25 17:01:43 user nova-compute[70659]:         <nova:port uuid="c3f11e4b-8894-4a84-a443-7f77a930fcc6">
Jul 25 17:01:43 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 17:01:43 user nova-compute[70659]:         </nova:port>
Jul 25 17:01:43 user nova-compute[70659]:       </nova:ports>
Jul 25 17:01:43 user nova-compute[70659]:     </nova:instance>
Jul 25 17:01:43 user nova-compute[70659]:   </metadata>
Jul 25 17:01:43 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:01:43 user nova-compute[70659]:     <system>
Jul 25 17:01:43 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:01:43 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:01:43 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:01:43 user nova-compute[70659]:       <entry name="serial">6bad1ca0-56cf-4a8d-b86c-adb41383e656</entry>
Jul 25 17:01:43 user nova-compute[70659]:       <entry name="uuid">6bad1ca0-56cf-4a8d-b86c-adb41383e656</entry>
Jul 25 17:01:43 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:01:43 user nova-compute[70659]:     </system>
Jul 25 17:01:43 user nova-compute[70659]:   </sysinfo>
Jul 25 17:01:43 user nova-compute[70659]:   <os>
Jul 25 17:01:43 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:01:43 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:01:43 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:01:43 user nova-compute[70659]:   </os>
Jul 25 17:01:43 user nova-compute[70659]:   <features>
Jul 25 17:01:43 user nova-compute[70659]:     <acpi/>
Jul 25 17:01:43 user nova-compute[70659]:     <apic/>
Jul 25 17:01:43 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:01:43 user nova-compute[70659]:   </features>
Jul 25 17:01:43 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:01:43 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:01:43 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:01:43 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:01:43 user nova-compute[70659]:   </clock>
Jul 25 17:01:43 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:01:43 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:01:43 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:01:43 user nova-compute[70659]:   </cpu>
Jul 25 17:01:43 user nova-compute[70659]:   <devices>
Jul 25 17:01:43 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:01:43 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:01:43 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk"/>
Jul 25 17:01:43 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:01:43 user nova-compute[70659]:     </disk>
Jul 25 17:01:43 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:01:43 user nova-compute[70659]:       <mac address="fa:16:3e:dc:64:14"/>
Jul 25 17:01:43 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:01:43 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:01:43 user nova-compute[70659]:       <target dev="tapc3f11e4b-88"/>
Jul 25 17:01:43 user nova-compute[70659]:     </interface>
Jul 25 17:01:43 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:01:43 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/console.log" append="off"/>
Jul 25 17:01:43 user nova-compute[70659]:     </serial>
Jul 25 17:01:43 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:01:43 user nova-compute[70659]:     <video>
Jul 25 17:01:43 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:01:43 user nova-compute[70659]:     </video>
Jul 25 17:01:43 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:01:43 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:01:43 user nova-compute[70659]:     </rng>
Jul 25 17:01:43 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:01:43 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:01:43 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:01:43 user nova-compute[70659]:     </memballoon>
Jul 25 17:01:43 user nova-compute[70659]:   </devices>
Jul 25 17:01:43 user nova-compute[70659]: </domain>
Jul 25 17:01:43 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:01:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1156147027',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1156147027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1156147',id=33,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/dwcQId82y6EOytzqb7leDM+gjPq1jKwdf34bv7rbxXsvKS+wfDxA61BnCELnAEjbBzGL6MEORSUMqamTGtdRO7ArwZgmIRjCFKHCjJbWrW81rNaS0A1yeXyFRwC8DFg==',key_name='tempest-keypair-711783819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fa5a2d8f3a548c7b7a2bd1747b253c3',ramdisk_id='',reservation_id='r-monww7gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1359034296',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:01:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1132e5daf391490f9440756cf9b2c9ca',uuid=6bad1ca0-56cf-4a8d-b86c-adb41383e656,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Converting VIF {"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:64:14,bridge_name='br-int',has_traffic_filtering=True,id=c3f11e4b-8894-4a84-a443-7f77a930fcc6,network=Network(0a5db3a9-b6e0-4750-9d90-12fba2fa119d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f11e4b-88') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG os_vif [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:64:14,bridge_name='br-int',has_traffic_filtering=True,id=c3f11e4b-8894-4a84-a443-7f77a930fcc6,network=Network(0a5db3a9-b6e0-4750-9d90-12fba2fa119d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f11e4b-88') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3f11e4b-88, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3f11e4b-88, col_values=(('external_ids', {'iface-id': 'c3f11e4b-8894-4a84-a443-7f77a930fcc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:64:14', 'vm-uuid': '6bad1ca0-56cf-4a8d-b86c-adb41383e656'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:43 user nova-compute[70659]: INFO os_vif [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:64:14,bridge_name='br-int',has_traffic_filtering=True,id=c3f11e4b-8894-4a84-a443-7f77a930fcc6,network=Network(0a5db3a9-b6e0-4750-9d90-12fba2fa119d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f11e4b-88')
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:01:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] No VIF found with MAC fa:16:3e:dc:64:14, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:01:44 user nova-compute[70659]: DEBUG nova.network.neutron [req-981d48e5-c515-4216-ac36-975d03b06283 req-de8de7c9-3060-4943-a8e2-e976ab0ed98a service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Updated VIF entry in instance network info cache for port c3f11e4b-8894-4a84-a443-7f77a930fcc6. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:01:44 user nova-compute[70659]: DEBUG nova.network.neutron [req-981d48e5-c515-4216-ac36-975d03b06283 req-de8de7c9-3060-4943-a8e2-e976ab0ed98a service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Updating instance_info_cache with network_info: [{"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:01:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-981d48e5-c515-4216-ac36-975d03b06283 req-de8de7c9-3060-4943-a8e2-e976ab0ed98a service nova] Releasing lock "refresh_cache-6bad1ca0-56cf-4a8d-b86c-adb41383e656" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:01:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-3ff716e5-4594-4510-b272-bae5d2e906f3 req-bcf2d59a-19e5-41f9-8846-80537677bd62 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received event network-vif-plugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3ff716e5-4594-4510-b272-bae5d2e906f3 req-bcf2d59a-19e5-41f9-8846-80537677bd62 service nova] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3ff716e5-4594-4510-b272-bae5d2e906f3 req-bcf2d59a-19e5-41f9-8846-80537677bd62 service nova] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3ff716e5-4594-4510-b272-bae5d2e906f3 req-bcf2d59a-19e5-41f9-8846-80537677bd62 service nova] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-3ff716e5-4594-4510-b272-bae5d2e906f3 req-bcf2d59a-19e5-41f9-8846-80537677bd62 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] No waiting events found dispatching network-vif-plugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:01:45 user nova-compute[70659]: WARNING nova.compute.manager [req-3ff716e5-4594-4510-b272-bae5d2e906f3 req-bcf2d59a-19e5-41f9-8846-80537677bd62 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received unexpected event network-vif-plugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 for instance with vm_state building and task_state spawning.
Jul 25 17:01:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304507.1936836, 6bad1ca0-56cf-4a8d-b86c-adb41383e656 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:01:47 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] VM Resumed (Lifecycle Event)
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:01:47 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Instance spawned successfully.
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:01:47 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304507.1951325, 6bad1ca0-56cf-4a8d-b86c-adb41383e656 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:01:47 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] VM Started (Lifecycle Event)
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:01:47 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:01:47 user nova-compute[70659]: INFO nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Took 5.64 seconds to spawn the instance on the hypervisor.
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-2a345c89-0a21-4a17-9f4b-6a0115d45f32 req-f143dc88-1042-4462-a483-8cb87d170d6a service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received event network-vif-plugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2a345c89-0a21-4a17-9f4b-6a0115d45f32 req-f143dc88-1042-4462-a483-8cb87d170d6a service nova] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2a345c89-0a21-4a17-9f4b-6a0115d45f32 req-f143dc88-1042-4462-a483-8cb87d170d6a service nova] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2a345c89-0a21-4a17-9f4b-6a0115d45f32 req-f143dc88-1042-4462-a483-8cb87d170d6a service nova] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-2a345c89-0a21-4a17-9f4b-6a0115d45f32 req-f143dc88-1042-4462-a483-8cb87d170d6a service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] No waiting events found dispatching network-vif-plugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:01:47 user nova-compute[70659]: WARNING nova.compute.manager [req-2a345c89-0a21-4a17-9f4b-6a0115d45f32 req-f143dc88-1042-4462-a483-8cb87d170d6a service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received unexpected event network-vif-plugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 for instance with vm_state building and task_state spawning.
Jul 25 17:01:47 user nova-compute[70659]: INFO nova.compute.manager [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Took 6.45 seconds to build instance.
Jul 25 17:01:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0b18d605-3556-46be-aacc-9b2a232c7657 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.546s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:49 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 17:01:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 17:01:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:53 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:54 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:01:59 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:01:59 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:01:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=25.188274383544922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:01:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:01:59 user nova-compute[70659]: INFO nova.compute.manager [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Detaching volume 4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f
Jul 25 17:02:00 user nova-compute[70659]: INFO nova.virt.block_device [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Attempting to driver detach volume 4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f from mountpoint /dev/vdb
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Attempting to detach device vdb from instance e3533a51-ce1c-4d49-9cef-49cc2ebbebed from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:02:00 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:02:00 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:02:00 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:02:00 user nova-compute[70659]:   <serial>4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f</serial>
Jul 25 17:02:00 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:02:00 user nova-compute[70659]: </disk>
Jul 25 17:02:00 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:02:00 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Successfully detached device vdb from instance e3533a51-ce1c-4d49-9cef-49cc2ebbebed from the persistent domain config.
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3533a51-ce1c-4d49-9cef-49cc2ebbebed from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:02:00 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:02:00 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:02:00 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:02:00 user nova-compute[70659]:   <serial>4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f</serial>
Jul 25 17:02:00 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:02:00 user nova-compute[70659]: </disk>
Jul 25 17:02:00 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e3533a51-ce1c-4d49-9cef-49cc2ebbebed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e006724d-e45a-405f-9084-544925aaa8ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 77750821-16ee-4945-88ff-a8445edab24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 6bad1ca0-56cf-4a8d-b86c-adb41383e656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304520.5677488, e3533a51-ce1c-4d49-9cef-49cc2ebbebed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3533a51-ce1c-4d49-9cef-49cc2ebbebed {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:02:00 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Successfully detached device vdb from instance e3533a51-ce1c-4d49-9cef-49cc2ebbebed from the live domain config.
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZzkYyro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:00 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac3d39-0682-40da-b7cf-81049fe91381]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[af10eae3-d3a3-4c0a-b033-17a043b36095]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:00 user nova-compute[70659]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f (non-flash)
Jul 25 17:02:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:00 user nova-compute[70659]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f (non-flash)
Jul 25 17:02:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd36d34280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78cd151-178c-4b2e-bbfc-d31fa803e2c0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[829ccafc-66ff-4adf-95e3-3c04360d0543]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d3dbb-d726-43cb-9560-5ea4883e44b5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e73806a-afbe-481d-870b-fd243f9f0552]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[edac1078-9881-4fa1-9779-091efe32aed4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65e27cb-ed35-43fc-b7d0-4a9c30d2f8e9]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f, portal: 172.16.0.220,3260]
Jul 25 17:02:00 user nova-compute[70659]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f, portal: 172.16.0.220,3260] successful.
Jul 25 17:02:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6691c0de-8d73-4239-b2e0-5a4caf727c2b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] <== disconnect_volume: return (311ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG nova.objects.instance [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'flavor' on Instance uuid e3533a51-ce1c-4d49-9cef-49cc2ebbebed {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c8f7a743-177f-47c3-a044-d0fdf944fc52 tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.868s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.861s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:01 user nova-compute[70659]: INFO nova.compute.manager [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Terminating instance
Jul 25 17:02:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-d787a52a-d700-4489-9eae-4d7f17ca0ab9 req-0cc40235-9f87-4179-9b30-644cb91bb883 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received event network-vif-unplugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d787a52a-d700-4489-9eae-4d7f17ca0ab9 req-0cc40235-9f87-4179-9b30-644cb91bb883 service nova] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d787a52a-d700-4489-9eae-4d7f17ca0ab9 req-0cc40235-9f87-4179-9b30-644cb91bb883 service nova] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d787a52a-d700-4489-9eae-4d7f17ca0ab9 req-0cc40235-9f87-4179-9b30-644cb91bb883 service nova] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-d787a52a-d700-4489-9eae-4d7f17ca0ab9 req-0cc40235-9f87-4179-9b30-644cb91bb883 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] No waiting events found dispatching network-vif-unplugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-d787a52a-d700-4489-9eae-4d7f17ca0ab9 req-0cc40235-9f87-4179-9b30-644cb91bb883 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received event network-vif-unplugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 17:02:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Instance destroyed successfully.
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lazy-loading 'resources' on Instance uuid e3533a51-ce1c-4d49-9cef-49cc2ebbebed {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-184977354',display_name='tempest-VolumesSnapshotTestJSON-instance-184977354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-184977354',id=30,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhdVXe6RCpAVAdF4bi99g4tafxaw/zoIJgMRL6lqvUx+tvwZapqgs5V887W6HSrLAL7phvuYwisP2+1DdOc7CzTsbi3bfeDK1olkCzNgfiAeqXzGZHAay57F4HQy8PqUQ==',key_name='tempest-keypair-298492302',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:59:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='299fab0987cc403994552275bf4a8e6e',ramdisk_id='',reservation_id='r-zcuvszff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-772652394',owner_user_name='tempest-VolumesSnapshotTestJSON-772652394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaa312fa9268469da0d93402717c0798',uuid=e3533a51-ce1c-4d49-9cef-49cc2ebbebed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converting VIF {"id": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "address": "fa:16:3e:b1:41:14", "network": {"id": "e5a3702e-5000-4555-ba61-cd80c1467f7f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1848907879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "299fab0987cc403994552275bf4a8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96a5fb5e-fd", "ovs_interfaceid": "96a5fb5e-fdd6-48d7-8340-2bf58b72be56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:41:14,bridge_name='br-int',has_traffic_filtering=True,id=96a5fb5e-fdd6-48d7-8340-2bf58b72be56,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96a5fb5e-fd') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_vif [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:41:14,bridge_name='br-int',has_traffic_filtering=True,id=96a5fb5e-fdd6-48d7-8340-2bf58b72be56,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96a5fb5e-fd') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96a5fb5e-fd, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:02:02 user nova-compute[70659]: INFO os_vif [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:41:14,bridge_name='br-int',has_traffic_filtering=True,id=96a5fb5e-fdd6-48d7-8340-2bf58b72be56,network=Network(e5a3702e-5000-4555-ba61-cd80c1467f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96a5fb5e-fd')
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZzkYyro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:02 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a0fb26c-d932-48e9-a1e7-9a2f3b2d400f', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb92cfa0-b450-4e23-93c9-a4602b645474]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1db1c2-0c0f-4bf0-9ada-1f53551bf950]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:02 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:02 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd107128c0>, {}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Disconnecting from: [] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] <== disconnect_volume: return (48ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:02:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Deleting instance files /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed_del
Jul 25 17:02:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Deletion of /opt/stack/data/nova/instances/e3533a51-ce1c-4d49-9cef-49cc2ebbebed_del complete
Jul 25 17:02:02 user nova-compute[70659]: INFO nova.compute.manager [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 25 17:02:02 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:02:02 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-a6554d5e-62b0-4161-9ff4-9d554326bbe6 req-088b8e92-0058-4f1e-b616-d6e5054e535d service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received event network-vif-plugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a6554d5e-62b0-4161-9ff4-9d554326bbe6 req-088b8e92-0058-4f1e-b616-d6e5054e535d service nova] Acquiring lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a6554d5e-62b0-4161-9ff4-9d554326bbe6 req-088b8e92-0058-4f1e-b616-d6e5054e535d service nova] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a6554d5e-62b0-4161-9ff4-9d554326bbe6 req-088b8e92-0058-4f1e-b616-d6e5054e535d service nova] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-a6554d5e-62b0-4161-9ff4-9d554326bbe6 req-088b8e92-0058-4f1e-b616-d6e5054e535d service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] No waiting events found dispatching network-vif-plugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:04 user nova-compute[70659]: WARNING nova.compute.manager [req-a6554d5e-62b0-4161-9ff4-9d554326bbe6 req-088b8e92-0058-4f1e-b616-d6e5054e535d service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received unexpected event network-vif-plugged-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 for instance with vm_state active and task_state deleting.
Jul 25 17:02:04 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:02:04 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Took 1.54 seconds to deallocate network for instance.
Jul 25 17:02:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-b53672f4-e3ff-4f51-9b00-5f36587e62f8 req-cec8240b-09f0-4ab6-9a45-1ced44232396 service nova] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Received event network-vif-deleted-96a5fb5e-fdd6-48d7-8340-2bf58b72be56 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:04 user nova-compute[70659]: WARNING nova.volume.cinder [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Attachment 54ecdd53-241c-4c11-9474-8a592857d987 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 54ecdd53-241c-4c11-9474-8a592857d987. (HTTP 404) (Request-ID: req-3d9e9083-2332-4726-a19d-74eb632fd367)
Jul 25 17:02:04 user nova-compute[70659]: INFO nova.compute.manager [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Took 0.04 seconds to detach 1 volumes for instance.
Jul 25 17:02:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:02:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:04 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Deleted allocations for instance e3533a51-ce1c-4d49-9cef-49cc2ebbebed
Jul 25 17:02:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7880b0e6-583b-4a14-8188-b0d281891afc tempest-VolumesSnapshotTestJSON-772652394 tempest-VolumesSnapshotTestJSON-772652394-project-member] Lock "e3533a51-ce1c-4d49-9cef-49cc2ebbebed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:07 user nova-compute[70659]: INFO nova.compute.manager [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Terminating instance
Jul 25 17:02:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-8ecf9a60-2cbb-439c-8963-0e1693d427d9 req-66abc5df-89d3-4e17-84e9-035eb24bf3bb service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-unplugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8ecf9a60-2cbb-439c-8963-0e1693d427d9 req-66abc5df-89d3-4e17-84e9-035eb24bf3bb service nova] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8ecf9a60-2cbb-439c-8963-0e1693d427d9 req-66abc5df-89d3-4e17-84e9-035eb24bf3bb service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8ecf9a60-2cbb-439c-8963-0e1693d427d9 req-66abc5df-89d3-4e17-84e9-035eb24bf3bb service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-8ecf9a60-2cbb-439c-8963-0e1693d427d9 req-66abc5df-89d3-4e17-84e9-035eb24bf3bb service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] No waiting events found dispatching network-vif-unplugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-8ecf9a60-2cbb-439c-8963-0e1693d427d9 req-66abc5df-89d3-4e17-84e9-035eb24bf3bb service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-unplugged-f5aac860-4fc0-4097-8275-2243915c868b for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:02:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Instance destroyed successfully.
Jul 25 17:02:08 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'resources' on Instance uuid fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641327865',display_name='tempest-ServerRescueNegativeTestJSON-server-1641327865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641327865',id=3,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-dd57sdib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:47:59Z,user_data=None,user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "f5aac860-4fc0-4097-8275-2243915c868b", "address": "fa:16:3e:c2:a0:42", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aac860-4f", "ovs_interfaceid": "f5aac860-4fc0-4097-8275-2243915c868b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a0:42,bridge_name='br-int',has_traffic_filtering=True,id=f5aac860-4fc0-4097-8275-2243915c868b,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5aac860-4f') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG os_vif [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a0:42,bridge_name='br-int',has_traffic_filtering=True,id=f5aac860-4fc0-4097-8275-2243915c868b,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5aac860-4f') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5aac860-4f, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:08 user nova-compute[70659]: INFO os_vif [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a0:42,bridge_name='br-int',has_traffic_filtering=True,id=f5aac860-4fc0-4097-8275-2243915c868b,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5aac860-4f')
Jul 25 17:02:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Deleting instance files /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7_del
Jul 25 17:02:08 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Deletion of /opt/stack/data/nova/instances/fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7_del complete
Jul 25 17:02:08 user nova-compute[70659]: INFO nova.compute.manager [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 25 17:02:08 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:02:08 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:02:08 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Took 0.74 seconds to deallocate network for instance.
Jul 25 17:02:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:09 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:02:09 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:02:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:09 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Deleted allocations for instance fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7
Jul 25 17:02:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b330aee3-1e62-4d28-b299-9577614bbb5e tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-cf8441ee-9fe2-419b-834c-d94034c4b54f req-262a73c1-a55c-4734-a2dd-6fe7142d3c51 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cf8441ee-9fe2-419b-834c-d94034c4b54f req-262a73c1-a55c-4734-a2dd-6fe7142d3c51 service nova] Acquiring lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cf8441ee-9fe2-419b-834c-d94034c4b54f req-262a73c1-a55c-4734-a2dd-6fe7142d3c51 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cf8441ee-9fe2-419b-834c-d94034c4b54f req-262a73c1-a55c-4734-a2dd-6fe7142d3c51 service nova] Lock "fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-cf8441ee-9fe2-419b-834c-d94034c4b54f req-262a73c1-a55c-4734-a2dd-6fe7142d3c51 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] No waiting events found dispatching network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:09 user nova-compute[70659]: WARNING nova.compute.manager [req-cf8441ee-9fe2-419b-834c-d94034c4b54f req-262a73c1-a55c-4734-a2dd-6fe7142d3c51 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received unexpected event network-vif-plugged-f5aac860-4fc0-4097-8275-2243915c868b for instance with vm_state deleted and task_state None.
Jul 25 17:02:09 user nova-compute[70659]: DEBUG nova.compute.manager [req-cf8441ee-9fe2-419b-834c-d94034c4b54f req-262a73c1-a55c-4734-a2dd-6fe7142d3c51 service nova] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Received event network-vif-deleted-f5aac860-4fc0-4097-8275-2243915c868b {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:17 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304522.5340776, e3533a51-ce1c-4d49-9cef-49cc2ebbebed => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:02:17 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] VM Stopped (Lifecycle Event)
Jul 25 17:02:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72e0214a-9c46-4c52-b899-6c118c2f2102 None None] [instance: e3533a51-ce1c-4d49-9cef-49cc2ebbebed] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:02:18 user nova-compute[70659]: INFO nova.compute.claims [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Claim successful on node user
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:02:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.policy [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b14f37927ee848b890ec02b3068251f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775d6e7c342a492f815f2c68c62b291a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:02:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Creating image(s)
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "/opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "/opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "0d814b6d0b555ed6ccf81229ea278478560ff1ed" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "0d814b6d0b555ed6ccf81229ea278478560ff1ed" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:19 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Successfully created port: ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:02:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed.part --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:19 user nova-compute[70659]: DEBUG nova.virt.images [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 17:02:19 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 17:02:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed.part /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed.part /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed.converted" returned: 0 in 0.536s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "0d814b6d0b555ed6ccf81229ea278478560ff1ed" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.313s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Successfully updated port: ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquired lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-e5f5340a-d67e-4edf-b9c9-a28bf935d867 req-d47373fb-04bb-44b8-9478-7ec6701f449e service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-e5f5340a-d67e-4edf-b9c9-a28bf935d867 req-d47373fb-04bb-44b8-9478-7ec6701f449e service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing instance network info cache due to event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e5f5340a-d67e-4edf-b9c9-a28bf935d867 req-d47373fb-04bb-44b8-9478-7ec6701f449e service nova] Acquiring lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed --force-share --output=json" returned: 0 in 0.159s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "0d814b6d0b555ed6ccf81229ea278478560ff1ed" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "0d814b6d0b555ed6ccf81229ea278478560ff1ed" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed,backing_fmt=raw /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed,backing_fmt=raw /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk 1073741824" returned: 0 in 0.052s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "0d814b6d0b555ed6ccf81229ea278478560ff1ed" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating instance_info_cache with network_info: [{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Releasing lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Instance network_info: |[{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e5f5340a-d67e-4edf-b9c9-a28bf935d867 req-d47373fb-04bb-44b8-9478-7ec6701f449e service nova] Acquired lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.network.neutron [req-e5f5340a-d67e-4edf-b9c9-a28bf935d867 req-d47373fb-04bb-44b8-9478-7ec6701f449e service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Cannot resize image /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.objects.instance [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'migration_context' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Ensure instance console log exists: /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Start _get_guest_xml network_info=[{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T17:02:16Z,direct_url=<?>,disk_format='qcow2',id=d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f,min_disk=0,min_ram=0,name='tempest-scenario-img--1717239404',owner='775d6e7c342a492f815f2c68c62b291a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T17:02:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'd716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:02:20 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:02:20 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T17:02:16Z,direct_url=<?>,disk_format='qcow2',id=d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f,min_disk=0,min_ram=0,name='tempest-scenario-img--1717239404',owner='775d6e7c342a492f815f2c68c62b291a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T17:02:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:02:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1276348519',display_name='tempest-TestMinimumBasicScenario-server-1276348519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1276348519',id=34,image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP7iY75WewGd9w81yWLG0+aApzmPP1DdnbLIGJQjie10aI09rJyALWMwmNsSC+MotNHXs0rY3nOs6ehU+vvWvLRQsTX4H6VMaF2oCf/W+ixdSGtoMeVNIXKH6grRAXuEg==',key_name='tempest-TestMinimumBasicScenario-342159585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='775d6e7c342a492f815f2c68c62b291a',ramdisk_id='',reservation_id='r-kqj3kgb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-866741703',owner_user_name='tempest-TestMinimumBasicScenario-866741703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:02:19Z,user_data=None,user_id='b14f37927ee848b890ec02b3068251f3',uuid=a0f3fc7c-0f44-450b-a4c3-f628aad189ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converting VIF {"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.objects.instance [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'pci_devices' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:02:21 user nova-compute[70659]:   <uuid>a0f3fc7c-0f44-450b-a4c3-f628aad189ae</uuid>
Jul 25 17:02:21 user nova-compute[70659]:   <name>instance-00000022</name>
Jul 25 17:02:21 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:02:21 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:02:21 user nova-compute[70659]:   <metadata>
Jul 25 17:02:21 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:02:21 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:02:21 user nova-compute[70659]:       <nova:name>tempest-TestMinimumBasicScenario-server-1276348519</nova:name>
Jul 25 17:02:21 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:02:20</nova:creationTime>
Jul 25 17:02:21 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:02:21 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:02:21 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:02:21 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:02:21 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:02:21 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:02:21 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:02:21 user nova-compute[70659]:       <nova:owner>
Jul 25 17:02:21 user nova-compute[70659]:         <nova:user uuid="b14f37927ee848b890ec02b3068251f3">tempest-TestMinimumBasicScenario-866741703-project-member</nova:user>
Jul 25 17:02:21 user nova-compute[70659]:         <nova:project uuid="775d6e7c342a492f815f2c68c62b291a">tempest-TestMinimumBasicScenario-866741703</nova:project>
Jul 25 17:02:21 user nova-compute[70659]:       </nova:owner>
Jul 25 17:02:21 user nova-compute[70659]:       <nova:root type="image" uuid="d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f"/>
Jul 25 17:02:21 user nova-compute[70659]:       <nova:ports>
Jul 25 17:02:21 user nova-compute[70659]:         <nova:port uuid="ebdedf5d-69f8-4141-a81c-301b7347b9c4">
Jul 25 17:02:21 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 17:02:21 user nova-compute[70659]:         </nova:port>
Jul 25 17:02:21 user nova-compute[70659]:       </nova:ports>
Jul 25 17:02:21 user nova-compute[70659]:     </nova:instance>
Jul 25 17:02:21 user nova-compute[70659]:   </metadata>
Jul 25 17:02:21 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:02:21 user nova-compute[70659]:     <system>
Jul 25 17:02:21 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:02:21 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:02:21 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:02:21 user nova-compute[70659]:       <entry name="serial">a0f3fc7c-0f44-450b-a4c3-f628aad189ae</entry>
Jul 25 17:02:21 user nova-compute[70659]:       <entry name="uuid">a0f3fc7c-0f44-450b-a4c3-f628aad189ae</entry>
Jul 25 17:02:21 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:02:21 user nova-compute[70659]:     </system>
Jul 25 17:02:21 user nova-compute[70659]:   </sysinfo>
Jul 25 17:02:21 user nova-compute[70659]:   <os>
Jul 25 17:02:21 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:02:21 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:02:21 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:02:21 user nova-compute[70659]:   </os>
Jul 25 17:02:21 user nova-compute[70659]:   <features>
Jul 25 17:02:21 user nova-compute[70659]:     <acpi/>
Jul 25 17:02:21 user nova-compute[70659]:     <apic/>
Jul 25 17:02:21 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:02:21 user nova-compute[70659]:   </features>
Jul 25 17:02:21 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:02:21 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:02:21 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:02:21 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:02:21 user nova-compute[70659]:   </clock>
Jul 25 17:02:21 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:02:21 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:02:21 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:02:21 user nova-compute[70659]:   </cpu>
Jul 25 17:02:21 user nova-compute[70659]:   <devices>
Jul 25 17:02:21 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:02:21 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:02:21 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk"/>
Jul 25 17:02:21 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:02:21 user nova-compute[70659]:     </disk>
Jul 25 17:02:21 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:02:21 user nova-compute[70659]:       <mac address="fa:16:3e:66:54:bd"/>
Jul 25 17:02:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:02:21 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:02:21 user nova-compute[70659]:       <target dev="tapebdedf5d-69"/>
Jul 25 17:02:21 user nova-compute[70659]:     </interface>
Jul 25 17:02:21 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:02:21 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/console.log" append="off"/>
Jul 25 17:02:21 user nova-compute[70659]:     </serial>
Jul 25 17:02:21 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:02:21 user nova-compute[70659]:     <video>
Jul 25 17:02:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:02:21 user nova-compute[70659]:     </video>
Jul 25 17:02:21 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:02:21 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:02:21 user nova-compute[70659]:     </rng>
Jul 25 17:02:21 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:02:21 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:02:21 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:02:21 user nova-compute[70659]:     </memballoon>
Jul 25 17:02:21 user nova-compute[70659]:   </devices>
Jul 25 17:02:21 user nova-compute[70659]: </domain>
Jul 25 17:02:21 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1276348519',display_name='tempest-TestMinimumBasicScenario-server-1276348519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1276348519',id=34,image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP7iY75WewGd9w81yWLG0+aApzmPP1DdnbLIGJQjie10aI09rJyALWMwmNsSC+MotNHXs0rY3nOs6ehU+vvWvLRQsTX4H6VMaF2oCf/W+ixdSGtoMeVNIXKH6grRAXuEg==',key_name='tempest-TestMinimumBasicScenario-342159585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='775d6e7c342a492f815f2c68c62b291a',ramdisk_id='',reservation_id='r-kqj3kgb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-866741703',owner_user_name='tempest-TestMinimumBasicScenario-866741703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:02:19Z,user_data=None,user_id='b14f37927ee848b890ec02b3068251f3',uuid=a0f3fc7c-0f44-450b-a4c3-f628aad189ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converting VIF {"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG os_vif [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebdedf5d-69, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebdedf5d-69, col_values=(('external_ids', {'iface-id': 'ebdedf5d-69f8-4141-a81c-301b7347b9c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:54:bd', 'vm-uuid': 'a0f3fc7c-0f44-450b-a4c3-f628aad189ae'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:21 user nova-compute[70659]: INFO os_vif [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69')
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No VIF found with MAC fa:16:3e:66:54:bd, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-e5f5340a-d67e-4edf-b9c9-a28bf935d867 req-d47373fb-04bb-44b8-9478-7ec6701f449e service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updated VIF entry in instance network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-e5f5340a-d67e-4edf-b9c9-a28bf935d867 req-d47373fb-04bb-44b8-9478-7ec6701f449e service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating instance_info_cache with network_info: [{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:02:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e5f5340a-d67e-4edf-b9c9-a28bf935d867 req-d47373fb-04bb-44b8-9478-7ec6701f449e service nova] Releasing lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:02:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-9aa894dd-ac78-48a1-a675-964824bdccd7 req-79cd2f33-bdf9-4f60-84ba-59f9cca8f488 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9aa894dd-ac78-48a1-a675-964824bdccd7 req-79cd2f33-bdf9-4f60-84ba-59f9cca8f488 service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9aa894dd-ac78-48a1-a675-964824bdccd7 req-79cd2f33-bdf9-4f60-84ba-59f9cca8f488 service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9aa894dd-ac78-48a1-a675-964824bdccd7 req-79cd2f33-bdf9-4f60-84ba-59f9cca8f488 service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-9aa894dd-ac78-48a1-a675-964824bdccd7 req-79cd2f33-bdf9-4f60-84ba-59f9cca8f488 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:22 user nova-compute[70659]: WARNING nova.compute.manager [req-9aa894dd-ac78-48a1-a675-964824bdccd7 req-79cd2f33-bdf9-4f60-84ba-59f9cca8f488 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received unexpected event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with vm_state building and task_state spawning.
Jul 25 17:02:23 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304528.1125677, fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:02:23 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] VM Stopped (Lifecycle Event)
Jul 25 17:02:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f6a2276d-853f-4a11-8a44-fc3a5b262647 None None] [instance: fbeeab21-dbed-4cb7-bfa4-7fc682bdd1d7] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304544.597377, a0f3fc7c-0f44-450b-a4c3-f628aad189ae => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:02:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] VM Resumed (Lifecycle Event)
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:02:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Instance spawned successfully.
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304544.5985534, a0f3fc7c-0f44-450b-a4c3-f628aad189ae => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:02:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] VM Started (Lifecycle Event)
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:02:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:02:24 user nova-compute[70659]: INFO nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Took 5.76 seconds to spawn the instance on the hypervisor.
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:24 user nova-compute[70659]: INFO nova.compute.manager [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Took 6.49 seconds to build instance.
Jul 25 17:02:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e09ae6e8-d9db-49d9-9634-1c836ea54af9 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.574s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd7a789a-a407-4ad8-9812-2a30d6f83d88 req-b49a2b24-b445-4f9e-a6c7-3d6019c9f8cc service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7a789a-a407-4ad8-9812-2a30d6f83d88 req-b49a2b24-b445-4f9e-a6c7-3d6019c9f8cc service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7a789a-a407-4ad8-9812-2a30d6f83d88 req-b49a2b24-b445-4f9e-a6c7-3d6019c9f8cc service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fd7a789a-a407-4ad8-9812-2a30d6f83d88 req-b49a2b24-b445-4f9e-a6c7-3d6019c9f8cc service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-fd7a789a-a407-4ad8-9812-2a30d6f83d88 req-b49a2b24-b445-4f9e-a6c7-3d6019c9f8cc service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:24 user nova-compute[70659]: WARNING nova.compute.manager [req-fd7a789a-a407-4ad8-9812-2a30d6f83d88 req-b49a2b24-b445-4f9e-a6c7-3d6019c9f8cc service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received unexpected event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with vm_state active and task_state None.
Jul 25 17:02:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:32 user nova-compute[70659]: DEBUG nova.objects.instance [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'flavor' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:33 user nova-compute[70659]: INFO nova.compute.manager [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Attaching volume 24aafa45-075f-4cfc-9388-7e0b2478b3d7 to /dev/vdb
Jul 25 17:02:33 user nova-compute[70659]: DEBUG os_brick.utils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec988e4-1907-425a-aaf2-f0c21a374417]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[64790e31-18cd-47fb-a0aa-4ac176041952]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b913ef2-026d-4f31-9a5b-b44cf49f9738]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3166aa3a-75f8-4fee-a9e0-06b1ae26ac06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:02:33 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:02:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2084e716-3d4e-4724-ae6a-8c5375ac8fd6]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG os_brick.utils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:33 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating existing volume attachment record: 1b719eb8-828f-42e8-b644-75897271dd81 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:02:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:02:37 user nova-compute[70659]: INFO nova.compute.claims [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Claim successful on node user
Jul 25 17:02:37 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:02:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:02:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:02:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:02:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:02:38 user nova-compute[70659]: DEBUG nova.policy [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '913d51a0ff3746c5bdadd59fdf14e787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef5ee6f08d04772994840a8973da621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:02:38 user nova-compute[70659]: INFO nova.virt.block_device [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Booting with volume-backed-image cf818516-7014-4487-8846-a63b84aa1a5a at /dev/vda
Jul 25 17:02:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Successfully created port: 69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Successfully updated port: 69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquired lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-6da7f314-744b-42cf-ba6a-e4ade7d8e7e2 req-3d52dfdb-602c-4aff-a806-822b87a4f2a8 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-changed-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-6da7f314-744b-42cf-ba6a-e4ade7d8e7e2 req-3d52dfdb-602c-4aff-a806-822b87a4f2a8 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Refreshing instance network info cache due to event network-changed-69c79a6b-1381-4a30-bf75-896997767587. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6da7f314-744b-42cf-ba6a-e4ade7d8e7e2 req-3d52dfdb-602c-4aff-a806-822b87a4f2a8 service nova] Acquiring lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOQlfaLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:02:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:02:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:02:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:02:39 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6240bb6f-75bf-4a8b-a67e-2f4c3e3ca4b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:02:39 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[843d53c6-ba17-4e81-a85f-0b2ffc74aa0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7] added
Jul 25 17:02:39 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a8a1b7-5b66-4310-b85a-2d707ddf159c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd811a7c-93f3-429d-9a7a-039387dfdbd4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qOQlfaLw {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qOQlfaLw" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa953f9b-4ca1-4de3-856c-4bc4bded287a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qOQlfaLw'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2048ec1f-3083-4b86-b2a5-daaf7da64fc0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0d32da-e790-46d3-b83f-7a140f57ddfe]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c019ef7-cba4-45cb-a212-b5657634ce9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260]
Jul 25 17:02:40 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260] successful.
Jul 25 17:02:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Updating instance_info_cache with network_info: [{"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.090s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c6c6c4-b6b8-4e4d-b8e4-856e0414a02d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Releasing lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Instance network_info: |[{"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6da7f314-744b-42cf-ba6a-e4ade7d8e7e2 req-3d52dfdb-602c-4aff-a806-822b87a4f2a8 service nova] Acquired lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.network.neutron [req-6da7f314-744b-42cf-ba6a-e4ade7d8e7e2 req-3d52dfdb-602c-4aff-a806-822b87a4f2a8 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Refreshing network info cache for port 69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a261081-7bab-4776-973a-dcadff07fb1e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:40 user nova-compute[70659]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:02:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:40 user nova-compute[70659]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:02:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:40 user nova-compute[70659]: WARNING nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid fc09d930-4a75-490b-a86a-08fe432d778c {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid e006724d-e45a-405f-9084-544925aaa8ad {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 77750821-16ee-4945-88ff-a8445edab24b {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 6bad1ca0-56cf-4a8d-b86c-adb41383e656 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "fc09d930-4a75-490b-a86a-08fe432d778c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "fc09d930-4a75-490b-a86a-08fe432d778c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "73980900-2093-4338-8460-d91df2e2709d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "e006724d-e45a-405f-9084-544925aaa8ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "e006724d-e45a-405f-9084-544925aaa8ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "77750821-16ee-4945-88ff-a8445edab24b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb1352-e0f2-423c-8579-456f39578bcf]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOQlfaLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "fc09d930-4a75-490b-a86a-08fe432d778c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "73980900-2093-4338-8460-d91df2e2709d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "77750821-16ee-4945-88ff-a8445edab24b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "e006724d-e45a-405f-9084-544925aaa8ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.network.neutron [req-6da7f314-744b-42cf-ba6a-e4ade7d8e7e2 req-3d52dfdb-602c-4aff-a806-822b87a4f2a8 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Updated VIF entry in instance network info cache for port 69c79a6b-1381-4a30-bf75-896997767587. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG nova.network.neutron [req-6da7f314-744b-42cf-ba6a-e4ade7d8e7e2 req-3d52dfdb-602c-4aff-a806-822b87a4f2a8 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Updating instance_info_cache with network_info: [{"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:02:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6da7f314-744b-42cf-ba6a-e4ade7d8e7e2 req-3d52dfdb-602c-4aff-a806-822b87a4f2a8 service nova] Releasing lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23538343465323332', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538343465323332', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG nova.objects.instance [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'flavor' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:02:41 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:02:41 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:02:41 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:02:41 user nova-compute[70659]:   <serial>24aafa45-075f-4cfc-9388-7e0b2478b3d7</serial>
Jul 25 17:02:41 user nova-compute[70659]: </disk>
Jul 25 17:02:41 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No VIF found with MAC fa:16:3e:a5:e2:58, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-208a1876-0fb9-4bf0-a6e2-1e1a90abfe05 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.832s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "612d6677-e182-4337-a33e-622efb364df2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.697s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "612d6677-e182-4337-a33e-622efb364df2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:43 user nova-compute[70659]: INFO nova.compute.manager [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Rebuilding instance
Jul 25 17:02:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'trusted_certs' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'pci_requests' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'pci_devices' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'resources' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'migration_context' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70659) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG os_brick.utils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a92998-c9cd-4207-9657-f3db0f1fbf07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[80846e5e-8784-4337-a530-3ca531b9cee4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bba54a-4cd0-4c76-8abf-12c13460b9e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88aa594-eae3-4424-8b02-4034e7f265ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:02:43 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:02:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6510ef7-0a45-4a0a-b2b4-ce52190fd937]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.utils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Updating existing volume attachment record: 06c72e84-84b3-4893-8fbb-34fad2e7ad6e {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-b778f87f-a9ba-4c80-b55a-0eca4b83f2b7 req-2db82517-8be6-428b-b52e-661384ffb48b service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-unplugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b778f87f-a9ba-4c80-b55a-0eca4b83f2b7 req-2db82517-8be6-428b-b52e-661384ffb48b service nova] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b778f87f-a9ba-4c80-b55a-0eca4b83f2b7 req-2db82517-8be6-428b-b52e-661384ffb48b service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b778f87f-a9ba-4c80-b55a-0eca4b83f2b7 req-2db82517-8be6-428b-b52e-661384ffb48b service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-b778f87f-a9ba-4c80-b55a-0eca4b83f2b7 req-2db82517-8be6-428b-b52e-661384ffb48b service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] No waiting events found dispatching network-vif-unplugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:44 user nova-compute[70659]: WARNING nova.compute.manager [req-b778f87f-a9ba-4c80-b55a-0eca4b83f2b7 req-2db82517-8be6-428b-b52e-661384ffb48b service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received unexpected event network-vif-unplugged-2522dddf-d653-4f79-9db4-4785f9566253 for instance with vm_state active and task_state rebuilding.
Jul 25 17:02:44 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] Instance destroyed successfully.
Jul 25 17:02:44 user nova-compute[70659]: INFO nova.compute.manager [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Detaching volume 24aafa45-075f-4cfc-9388-7e0b2478b3d7
Jul 25 17:02:44 user nova-compute[70659]: INFO nova.virt.block_device [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Attempting to driver detach volume 24aafa45-075f-4cfc-9388-7e0b2478b3d7 from mountpoint /dev/vdb
Jul 25 17:02:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Attempting to detach device vdb from instance 612d6677-e182-4337-a33e-622efb364df2 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:02:44 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:02:44 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:02:44 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:02:44 user nova-compute[70659]:   <serial>24aafa45-075f-4cfc-9388-7e0b2478b3d7</serial>
Jul 25 17:02:44 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:02:44 user nova-compute[70659]: </disk>
Jul 25 17:02:44 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:02:44 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully detached device vdb from instance 612d6677-e182-4337-a33e-622efb364df2 from the persistent domain config.
Jul 25 17:02:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOQlfaLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:44 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fadf4ce-297c-490c-90b1-cee676c4b582]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[50556cae-74f6-4104-92e5-26c0d1c96ef9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:44 user nova-compute[70659]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:02:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:44 user nova-compute[70659]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:02:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd28253f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c56232-6d46-4129-affa-9691f3c5275f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[034cd9fe-d0d2-4927-a8ca-cde593fd0067]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e6c91b-c093-4179-89f2-32d2233b81c9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef97de8c-29d2-4d73-9254-86f9124d2097]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:02:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc661ddc-e681-4331-a1f0-2fcedce4b11f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d3b04-00c8-4397-b39c-69e1503d6838]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260]
Jul 25 17:02:45 user nova-compute[70659]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260] successful.
Jul 25 17:02:45 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c0a0cc-5168-4400-b12e-0bc45e7241e5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== disconnect_volume: return (258ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:02:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-66a111bc-7a03-434c-9557-37b117b9579c req-1492d4d1-5d6f-465c-9cd2-a713263b8ae3 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-66a111bc-7a03-434c-9557-37b117b9579c req-1492d4d1-5d6f-465c-9cd2-a713263b8ae3 service nova] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-66a111bc-7a03-434c-9557-37b117b9579c req-1492d4d1-5d6f-465c-9cd2-a713263b8ae3 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-66a111bc-7a03-434c-9557-37b117b9579c req-1492d4d1-5d6f-465c-9cd2-a713263b8ae3 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-66a111bc-7a03-434c-9557-37b117b9579c req-1492d4d1-5d6f-465c-9cd2-a713263b8ae3 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] No waiting events found dispatching network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:46 user nova-compute[70659]: WARNING nova.compute.manager [req-66a111bc-7a03-434c-9557-37b117b9579c req-1492d4d1-5d6f-465c-9cd2-a713263b8ae3 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received unexpected event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 for instance with vm_state active and task_state rebuilding.
Jul 25 17:02:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:50 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] Instance destroyed successfully.
Jul 25 17:02:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1260012504',display_name='tempest-ServerActionsTestOtherA-server-1637307971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1260012504',id=29,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-b5pqhqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=612d6677-e182-4337-a33e-622efb364df2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG os_vif [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2522dddf-d6, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:50 user nova-compute[70659]: INFO os_vif [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6')
Jul 25 17:02:50 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOQlfaLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:50 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 17:02:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:02:50 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd423d9-6e30-42b8-b605-362e958ebaa1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea59d9d7-b95b-4210-bd08-e7e3eecbb50a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd28253250>, {}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Disconnecting from: [] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== disconnect_volume: return (53ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:02:51 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Deleting instance files /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2_del
Jul 25 17:02:51 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Deletion of /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2_del complete
Jul 25 17:02:51 user nova-compute[70659]: INFO nova.virt.block_device [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Booting with volume 24aafa45-075f-4cfc-9388-7e0b2478b3d7 at /dev/vdb
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.utils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f710195-3aaf-46ee-a50f-93e4f781db6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dcee57-8ad8-484c-bcf8-a8edf6eb1633]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[21188491-5be2-4feb-b5d1-5da625c30933]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[660c6f45-4424-4e89-8fea-7980d2f991bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:02:51 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Creating image(s)
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Ensure instance console log exists: /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Start _get_guest_xml network_info=[{"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '06c72e84-84b3-4893-8fbb-34fad2e7ad6e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPoCRjte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '856974f4-fd81-4d22-a316-5e08c36e35d6', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd765297-1ef5-4ad5-81e4-d5548b2d080a', 'serial': 'fd765297-1ef5-4ad5-81e4-d5548b2d080a'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:02:51 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e578c29-41cd-478f-8be2-7568ac4a3c96]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.utils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating existing volume attachment record: f8a5aa92-84ea-4811-bcf6-69f45fd01fe0 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:02:51 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:02:51 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPoCRjte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:51 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:02:51 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:02:51 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caa9f44-cde6-4515-a535-69e191fdfe80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:02:51 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93945d-d2c8-4e1e-9d06-e289988c7608]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a] added
Jul 25 17:02:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2be37d-9a9a-4feb-9e42-4472a70f4c63]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0013ee8-6314-4ac5-a27f-79f43a5655c2]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPoCRjte {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPoCRjte" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf62f5e-884a-40d2-9b08-b92a7ac6d0b8]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DPoCRjte'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2278115d-3b38-4a63-bd82-9ac504418da1]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1622a7e-a293-489b-99c6-b24735639884]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a37c5-4d16-4587-918a-68fd88297a86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a, portal: 172.16.0.220,3260]
Jul 25 17:02:51 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a, portal: 172.16.0.220,3260] successful.
Jul 25 17:02:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b39941f-6279-4ed6-9b86-adb074c944a6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c32543-fa33-43fb-b235-b0b4509b2865]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:51 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:02:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:02:51 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:02:51 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79725a1-15d2-45a7-bbff-a1f7c55e97de]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:51 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPoCRjte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26166383638383839', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166383638383839', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1495572339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1495572339',id=35,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-llo3qz24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:02:38Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=856974f4-fd81-4d22-a316-5e08c36e35d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:b1:ff,bridge_name='br-int',has_traffic_filtering=True,id=69c79a6b-1381-4a30-bf75-896997767587,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c79a6b-13') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'pci_devices' on Instance uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:02:52 user nova-compute[70659]:   <uuid>856974f4-fd81-4d22-a316-5e08c36e35d6</uuid>
Jul 25 17:02:52 user nova-compute[70659]:   <name>instance-00000023</name>
Jul 25 17:02:52 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:02:52 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:02:52 user nova-compute[70659]:   <metadata>
Jul 25 17:02:52 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:02:52 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:02:52 user nova-compute[70659]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1495572339</nova:name>
Jul 25 17:02:52 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:02:51</nova:creationTime>
Jul 25 17:02:52 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:02:52 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:02:52 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:02:52 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:02:52 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:02:52 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:02:52 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:02:52 user nova-compute[70659]:       <nova:owner>
Jul 25 17:02:52 user nova-compute[70659]:         <nova:user uuid="913d51a0ff3746c5bdadd59fdf14e787">tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member</nova:user>
Jul 25 17:02:52 user nova-compute[70659]:         <nova:project uuid="1ef5ee6f08d04772994840a8973da621">tempest-ServerBootFromVolumeStableRescueTest-191665891</nova:project>
Jul 25 17:02:52 user nova-compute[70659]:       </nova:owner>
Jul 25 17:02:52 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:02:52 user nova-compute[70659]:       <nova:ports>
Jul 25 17:02:52 user nova-compute[70659]:         <nova:port uuid="69c79a6b-1381-4a30-bf75-896997767587">
Jul 25 17:02:52 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 17:02:52 user nova-compute[70659]:         </nova:port>
Jul 25 17:02:52 user nova-compute[70659]:       </nova:ports>
Jul 25 17:02:52 user nova-compute[70659]:     </nova:instance>
Jul 25 17:02:52 user nova-compute[70659]:   </metadata>
Jul 25 17:02:52 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:02:52 user nova-compute[70659]:     <system>
Jul 25 17:02:52 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:02:52 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:02:52 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:02:52 user nova-compute[70659]:       <entry name="serial">856974f4-fd81-4d22-a316-5e08c36e35d6</entry>
Jul 25 17:02:52 user nova-compute[70659]:       <entry name="uuid">856974f4-fd81-4d22-a316-5e08c36e35d6</entry>
Jul 25 17:02:52 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:02:52 user nova-compute[70659]:     </system>
Jul 25 17:02:52 user nova-compute[70659]:   </sysinfo>
Jul 25 17:02:52 user nova-compute[70659]:   <os>
Jul 25 17:02:52 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:02:52 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:02:52 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:02:52 user nova-compute[70659]:   </os>
Jul 25 17:02:52 user nova-compute[70659]:   <features>
Jul 25 17:02:52 user nova-compute[70659]:     <acpi/>
Jul 25 17:02:52 user nova-compute[70659]:     <apic/>
Jul 25 17:02:52 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:02:52 user nova-compute[70659]:   </features>
Jul 25 17:02:52 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:02:52 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:02:52 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:02:52 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:02:52 user nova-compute[70659]:   </clock>
Jul 25 17:02:52 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:02:52 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:02:52 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:02:52 user nova-compute[70659]:   </cpu>
Jul 25 17:02:52 user nova-compute[70659]:   <devices>
Jul 25 17:02:52 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:02:52 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:02:52 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 17:02:52 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:02:52 user nova-compute[70659]:       <serial>fd765297-1ef5-4ad5-81e4-d5548b2d080a</serial>
Jul 25 17:02:52 user nova-compute[70659]:     </disk>
Jul 25 17:02:52 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:02:52 user nova-compute[70659]:       <mac address="fa:16:3e:f8:b1:ff"/>
Jul 25 17:02:52 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:02:52 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:02:52 user nova-compute[70659]:       <target dev="tap69c79a6b-13"/>
Jul 25 17:02:52 user nova-compute[70659]:     </interface>
Jul 25 17:02:52 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:02:52 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/console.log" append="off"/>
Jul 25 17:02:52 user nova-compute[70659]:     </serial>
Jul 25 17:02:52 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:02:52 user nova-compute[70659]:     <video>
Jul 25 17:02:52 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:02:52 user nova-compute[70659]:     </video>
Jul 25 17:02:52 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:02:52 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:02:52 user nova-compute[70659]:     </rng>
Jul 25 17:02:52 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:02:52 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:02:52 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:02:52 user nova-compute[70659]:     </memballoon>
Jul 25 17:02:52 user nova-compute[70659]:   </devices>
Jul 25 17:02:52 user nova-compute[70659]: </domain>
Jul 25 17:02:52 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1495572339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1495572339',id=35,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-llo3qz24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:02:38Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=856974f4-fd81-4d22-a316-5e08c36e35d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:b1:ff,bridge_name='br-int',has_traffic_filtering=True,id=69c79a6b-1381-4a30-bf75-896997767587,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c79a6b-13') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG os_vif [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:b1:ff,bridge_name='br-int',has_traffic_filtering=True,id=69c79a6b-1381-4a30-bf75-896997767587,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c79a6b-13') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69c79a6b-13, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69c79a6b-13, col_values=(('external_ids', {'iface-id': '69c79a6b-1381-4a30-bf75-896997767587', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:b1:ff', 'vm-uuid': '856974f4-fd81-4d22-a316-5e08c36e35d6'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:52 user nova-compute[70659]: INFO os_vif [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:b1:ff,bridge_name='br-int',has_traffic_filtering=True,id=69c79a6b-1381-4a30-bf75-896997767587,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c79a6b-13')
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:02:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No VIF found with MAC fa:16:3e:f8:b1:ff, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:02:53 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-75422b66-0af2-4b43-975b-a402430adabf req-4975d303-6cef-4e0f-a306-577c8e48fd16 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-75422b66-0af2-4b43-975b-a402430adabf req-4975d303-6cef-4e0f-a306-577c8e48fd16 service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-75422b66-0af2-4b43-975b-a402430adabf req-4975d303-6cef-4e0f-a306-577c8e48fd16 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-75422b66-0af2-4b43-975b-a402430adabf req-4975d303-6cef-4e0f-a306-577c8e48fd16 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-75422b66-0af2-4b43-975b-a402430adabf req-4975d303-6cef-4e0f-a306-577c8e48fd16 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:54 user nova-compute[70659]: WARNING nova.compute.manager [req-75422b66-0af2-4b43-975b-a402430adabf req-4975d303-6cef-4e0f-a306-577c8e48fd16 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state building and task_state spawning.
Jul 25 17:02:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304576.4694335, 856974f4-fd81-4d22-a316-5e08c36e35d6 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:02:56 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] VM Resumed (Lifecycle Event)
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:02:56 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Instance spawned successfully.
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:02:56 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304576.4712546, 856974f4-fd81-4d22-a316-5e08c36e35d6 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:02:56 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] VM Started (Lifecycle Event)
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received event network-changed-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Refreshing instance network info cache due to event network-changed-2c6378e0-e987-4aeb-93e7-d8ee73aead01. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] Acquiring lock "refresh_cache-77750821-16ee-4945-88ff-a8445edab24b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] Acquired lock "refresh_cache-77750821-16ee-4945-88ff-a8445edab24b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.network.neutron [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Refreshing network info cache for port 2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:02:56 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:02:56 user nova-compute[70659]: INFO nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Took 5.38 seconds to spawn the instance on the hypervisor.
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:02:56 user nova-compute[70659]: INFO nova.compute.manager [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Took 19.42 seconds to build instance.
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1592690f-2eb9-4f20-9c0c-9c49194bd5ec tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.594s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.566s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:56 user nova-compute[70659]: INFO nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.005s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG nova.network.neutron [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Updated VIF entry in instance network info cache for port 2c6378e0-e987-4aeb-93e7-d8ee73aead01. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG nova.network.neutron [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Updating instance_info_cache with network_info: [{"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] Releasing lock "refresh_cache-77750821-16ee-4945-88ff-a8445edab24b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:57 user nova-compute[70659]: WARNING nova.compute.manager [req-6b334e40-1b94-451c-828a-3996d99cb8a2 req-c4852cd3-3cf8-4dd2-add6-269de834e345 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state building and task_state spawning.
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:58 user nova-compute[70659]: INFO nova.compute.manager [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Terminating instance
Jul 25 17:02:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-373d0b0c-c5cb-48fc-a93f-7e6c46d4444f req-39c21d57-880b-4e36-9924-53cf98a5596e service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-373d0b0c-c5cb-48fc-a93f-7e6c46d4444f req-39c21d57-880b-4e36-9924-53cf98a5596e service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-373d0b0c-c5cb-48fc-a93f-7e6c46d4444f req-39c21d57-880b-4e36-9924-53cf98a5596e service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-373d0b0c-c5cb-48fc-a93f-7e6c46d4444f req-39c21d57-880b-4e36-9924-53cf98a5596e service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-373d0b0c-c5cb-48fc-a93f-7e6c46d4444f req-39c21d57-880b-4e36-9924-53cf98a5596e service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-373d0b0c-c5cb-48fc-a93f-7e6c46d4444f req-39c21d57-880b-4e36-9924-53cf98a5596e service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-unplugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:59 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Instance destroyed successfully.
Jul 25 17:02:59 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:02:59 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=25.127361297607422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lazy-loading 'resources' on Instance uuid c2800889-2d2e-4660-8bc9-f1f1782587d3 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.objects.instance [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'flavor' on Instance uuid 77750821-16ee-4945-88ff-a8445edab24b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1476762347',display_name='tempest-ServerRescueNegativeTestJSON-server-1476762347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1476762347',id=1,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20acc57667b418ba16f573fe81841ac',ramdisk_id='',reservation_id='r-1l240my5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1539045365',owner_user_name='tempest-ServerRescueNegativeTestJSON-1539045365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:52:40Z,user_data=None,user_id='9aaa70e5cce7418b96837e30769ac6aa',uuid=c2800889-2d2e-4660-8bc9-f1f1782587d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converting VIF {"id": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "address": "fa:16:3e:98:c5:8a", "network": {"id": "70a8308f-7108-4f4f-8402-b5deae1185fb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-202717080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20acc57667b418ba16f573fe81841ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f4caf2-a4", "ovs_interfaceid": "c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:c5:8a,bridge_name='br-int',has_traffic_filtering=True,id=c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f4caf2-a4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG os_vif [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:c5:8a,bridge_name='br-int',has_traffic_filtering=True,id=c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f4caf2-a4') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6f4caf2-a4, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:02:59 user nova-compute[70659]: INFO os_vif [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:c5:8a,bridge_name='br-int',has_traffic_filtering=True,id=c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1,network=Network(70a8308f-7108-4f4f-8402-b5deae1185fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f4caf2-a4')
Jul 25 17:02:59 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Deleting instance files /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3_del
Jul 25 17:02:59 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Deletion of /opt/stack/data/nova/instances/c2800889-2d2e-4660-8bc9-f1f1782587d3_del complete
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:59 user nova-compute[70659]: INFO nova.compute.manager [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:02:59 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Creating image(s)
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:59 user nova-compute[70659]: INFO nova.compute.manager [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Attaching volume 16cbb85e-6903-4c84-8d47-85b217f8b05a to /dev/vdb
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e006724d-e45a-405f-9084-544925aaa8ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 77750821-16ee-4945-88ff-a8445edab24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 6bad1ca0-56cf-4a8d-b86c-adb41383e656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 856974f4-fd81-4d22-a316-5e08c36e35d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.162s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG os_brick.utils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8873824d-b6c1-46ff-be75-22a3ef9d4d70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304564.609213, 612d6677-e182-4337-a33e-622efb364df2 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:02:59 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] VM Stopped (Lifecycle Event)
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e908dfae-e1c3-4e65-af4f-9f4291ac9cb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7f2721d6-ae2d-484b-a56d-1a18b8cddd12 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[23028aab-ecae-4ff5-b9ef-7a7f37631dda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fd5592-31b1-4f19-8a46-64dff06422e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.191s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:02:59 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbed443-374a-4de8-ba23-de5672c85cfa]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG os_brick.utils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Updating existing volume attachment record: 44ef01e0-cf4f-4a62-85f8-e607a2272d5a {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk 1073741824" returned: 0 in 0.081s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.194s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:02:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Took 0.75 seconds to deallocate network for instance.
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-e90bb45b-cdb4-495a-bf0b-9bbf2fd27009 req-536d0119-73c8-4c40-bd7a-0285a30e6602 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-deleted-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:03:00 user nova-compute[70659]: INFO nova.compute.manager [req-e90bb45b-cdb4-495a-bf0b-9bbf2fd27009 req-536d0119-73c8-4c40-bd7a-0285a30e6602 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Neutron deleted interface c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1; detaching it from the instance and deleting it from the info cache
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-e90bb45b-cdb4-495a-bf0b-9bbf2fd27009 req-536d0119-73c8-4c40-bd7a-0285a30e6602 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-e90bb45b-cdb4-495a-bf0b-9bbf2fd27009 req-536d0119-73c8-4c40-bd7a-0285a30e6602 service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Detach interface failed, port_id=c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1, reason: Instance c2800889-2d2e-4660-8bc9-f1f1782587d3 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Cannot resize image /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Ensure instance console log exists: /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Start _get_guest_xml network_info=[{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f8a5aa92-84ea-4811-bcf6-69f45fd01fe0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOQlfaLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '612d6677-e182-4337-a33e-622efb364df2', 'attached_at': '', 'detached_at': '', 'volume_id': '24aafa45-075f-4cfc-9388-7e0b2478b3d7', 'serial': '24aafa45-075f-4cfc-9388-7e0b2478b3d7'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:03:00 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 17:03:00 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.048s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.094s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'vcpu_model' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOQlfaLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:03:00 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:03:00 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:03:00 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b807f8-f74b-40f4-980d-da66311d0da7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:03:00 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ce400d-9554-4170-bfd0-805d26f01ec4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7] added
Jul 25 17:03:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[67138090-9ac6-41d1-8b36-02667f8dd801]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[64475818-1896-4659-8ae3-c5523f33c839]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qOQlfaLw {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qOQlfaLw" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b54668-2d81-4fdd-94e0-03e6a83b74ed]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qOQlfaLw'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa15a9e-bd7c-4395-a554-3332cb311ebd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f34380-b4dc-41fb-8ee3-edbbd6d707fa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:00 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:00 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4845b940-17ee-497e-a06c-77271614f490]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260]
Jul 25 17:03:00 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260] successful.
Jul 25 17:03:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5924b1b6-82d2-4226-8467-a763a6eec8ca]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb771c01-5d00-4808-b03d-fc5f2594708e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:00 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:00 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:00 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:00 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:00 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa596f7a-6ad1-44a4-a225-131e1461e801]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOQlfaLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb320cf0-1b41-4392-b8b5-f56507003456 req-59cbe41b-8ecb-4766-8a9b-ea0494069b1a service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb320cf0-1b41-4392-b8b5-f56507003456 req-59cbe41b-8ecb-4766-8a9b-ea0494069b1a service nova] Acquiring lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb320cf0-1b41-4392-b8b5-f56507003456 req-59cbe41b-8ecb-4766-8a9b-ea0494069b1a service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fb320cf0-1b41-4392-b8b5-f56507003456 req-59cbe41b-8ecb-4766-8a9b-ea0494069b1a service nova] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-fb320cf0-1b41-4392-b8b5-f56507003456 req-59cbe41b-8ecb-4766-8a9b-ea0494069b1a service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] No waiting events found dispatching network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:03:00 user nova-compute[70659]: WARNING nova.compute.manager [req-fb320cf0-1b41-4392-b8b5-f56507003456 req-59cbe41b-8ecb-4766-8a9b-ea0494069b1a service nova] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Received unexpected event network-vif-plugged-c6f4caf2-a4cd-4d62-83cf-a42006e9b9b1 for instance with vm_state deleted and task_state None.
Jul 25 17:03:00 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Deleted allocations for instance c2800889-2d2e-4660-8bc9-f1f1782587d3
Jul 25 17:03:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4da7de08-d5fc-4e5a-9080-2f1a395401f9 tempest-ServerRescueNegativeTestJSON-1539045365 tempest-ServerRescueNegativeTestJSON-1539045365-project-member] Lock "c2800889-2d2e-4660-8bc9-f1f1782587d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23538343465323332', 'path': '/dev/sdd'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538343465323332', 'path': '/dev/sdd'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1260012504',display_name='tempest-ServerActionsTestOtherA-server-1637307971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1260012504',id=29,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-b5pqhqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=612d6677-e182-4337-a33e-622efb364df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:03:01 user nova-compute[70659]:   <uuid>612d6677-e182-4337-a33e-622efb364df2</uuid>
Jul 25 17:03:01 user nova-compute[70659]:   <name>instance-0000001d</name>
Jul 25 17:03:01 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:03:01 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:03:01 user nova-compute[70659]:   <metadata>
Jul 25 17:03:01 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:03:01 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:03:01 user nova-compute[70659]:       <nova:name>tempest-ServerActionsTestOtherA-server-1637307971</nova:name>
Jul 25 17:03:01 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:03:00</nova:creationTime>
Jul 25 17:03:01 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:03:01 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:03:01 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:03:01 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:03:01 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:03:01 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:03:01 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:03:01 user nova-compute[70659]:       <nova:owner>
Jul 25 17:03:01 user nova-compute[70659]:         <nova:user uuid="4f29db3ae5934862b72e71e6863b46a6">tempest-ServerActionsTestOtherA-1965201562-project-member</nova:user>
Jul 25 17:03:01 user nova-compute[70659]:         <nova:project uuid="77a3bf6c11a04274b5059bd9dd6be00e">tempest-ServerActionsTestOtherA-1965201562</nova:project>
Jul 25 17:03:01 user nova-compute[70659]:       </nova:owner>
Jul 25 17:03:01 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:03:01 user nova-compute[70659]:       <nova:ports>
Jul 25 17:03:01 user nova-compute[70659]:         <nova:port uuid="2522dddf-d653-4f79-9db4-4785f9566253">
Jul 25 17:03:01 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 17:03:01 user nova-compute[70659]:         </nova:port>
Jul 25 17:03:01 user nova-compute[70659]:       </nova:ports>
Jul 25 17:03:01 user nova-compute[70659]:     </nova:instance>
Jul 25 17:03:01 user nova-compute[70659]:   </metadata>
Jul 25 17:03:01 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:03:01 user nova-compute[70659]:     <system>
Jul 25 17:03:01 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:03:01 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:03:01 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:03:01 user nova-compute[70659]:       <entry name="serial">612d6677-e182-4337-a33e-622efb364df2</entry>
Jul 25 17:03:01 user nova-compute[70659]:       <entry name="uuid">612d6677-e182-4337-a33e-622efb364df2</entry>
Jul 25 17:03:01 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:03:01 user nova-compute[70659]:     </system>
Jul 25 17:03:01 user nova-compute[70659]:   </sysinfo>
Jul 25 17:03:01 user nova-compute[70659]:   <os>
Jul 25 17:03:01 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:03:01 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:03:01 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:03:01 user nova-compute[70659]:   </os>
Jul 25 17:03:01 user nova-compute[70659]:   <features>
Jul 25 17:03:01 user nova-compute[70659]:     <acpi/>
Jul 25 17:03:01 user nova-compute[70659]:     <apic/>
Jul 25 17:03:01 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:03:01 user nova-compute[70659]:   </features>
Jul 25 17:03:01 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:03:01 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:03:01 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:03:01 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:03:01 user nova-compute[70659]:   </clock>
Jul 25 17:03:01 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:03:01 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:03:01 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:03:01 user nova-compute[70659]:   </cpu>
Jul 25 17:03:01 user nova-compute[70659]:   <devices>
Jul 25 17:03:01 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:03:01 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:03:01 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk"/>
Jul 25 17:03:01 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:03:01 user nova-compute[70659]:     </disk>
Jul 25 17:03:01 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:03:01 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:03:01 user nova-compute[70659]:       <source dev="/dev/sdd"/>
Jul 25 17:03:01 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 17:03:01 user nova-compute[70659]:       <serial>24aafa45-075f-4cfc-9388-7e0b2478b3d7</serial>
Jul 25 17:03:01 user nova-compute[70659]:     </disk>
Jul 25 17:03:01 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:03:01 user nova-compute[70659]:       <mac address="fa:16:3e:a5:e2:58"/>
Jul 25 17:03:01 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:03:01 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:03:01 user nova-compute[70659]:       <target dev="tap2522dddf-d6"/>
Jul 25 17:03:01 user nova-compute[70659]:     </interface>
Jul 25 17:03:01 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:03:01 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/console.log" append="off"/>
Jul 25 17:03:01 user nova-compute[70659]:     </serial>
Jul 25 17:03:01 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:03:01 user nova-compute[70659]:     <video>
Jul 25 17:03:01 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:03:01 user nova-compute[70659]:     </video>
Jul 25 17:03:01 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:03:01 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:03:01 user nova-compute[70659]:     </rng>
Jul 25 17:03:01 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:03:01 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:03:01 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:03:01 user nova-compute[70659]:     </memballoon>
Jul 25 17:03:01 user nova-compute[70659]:   </devices>
Jul 25 17:03:01 user nova-compute[70659]: </domain>
Jul 25 17:03:01 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1260012504',display_name='tempest-ServerActionsTestOtherA-server-1637307971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1260012504',id=29,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-b5pqhqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=612d6677-e182-4337-a33e-622efb364df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG os_vif [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2522dddf-d6, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2522dddf-d6, col_values=(('external_ids', {'iface-id': '2522dddf-d653-4f79-9db4-4785f9566253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:e2:58', 'vm-uuid': '612d6677-e182-4337-a33e-622efb364df2'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:01 user nova-compute[70659]: INFO os_vif [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6')
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:03:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No VIF found with MAC fa:16:3e:a5:e2:58, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:03:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-7f493300-f9ee-4cba-bf35-2709fdabbd36 req-d9824a3b-94b5-4877-9643-8dd4ae248e7d service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:03:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f493300-f9ee-4cba-bf35-2709fdabbd36 req-d9824a3b-94b5-4877-9643-8dd4ae248e7d service nova] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f493300-f9ee-4cba-bf35-2709fdabbd36 req-d9824a3b-94b5-4877-9643-8dd4ae248e7d service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7f493300-f9ee-4cba-bf35-2709fdabbd36 req-d9824a3b-94b5-4877-9643-8dd4ae248e7d service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-7f493300-f9ee-4cba-bf35-2709fdabbd36 req-d9824a3b-94b5-4877-9643-8dd4ae248e7d service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] No waiting events found dispatching network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:03:03 user nova-compute[70659]: WARNING nova.compute.manager [req-7f493300-f9ee-4cba-bf35-2709fdabbd36 req-d9824a3b-94b5-4877-9643-8dd4ae248e7d service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received unexpected event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 for instance with vm_state active and task_state rebuild_spawning.
Jul 25 17:03:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:04 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:04 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid fc09d930-4a75-490b-a86a-08fe432d778c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304585.4900177, 612d6677-e182-4337-a33e-622efb364df2 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:03:05 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] VM Resumed (Lifecycle Event)
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:03:05 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] Instance spawned successfully.
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:05 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304585.4933944, 612d6677-e182-4337-a33e-622efb364df2 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:03:05 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] VM Started (Lifecycle Event)
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:03:05 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 17:03:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70659) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-5df8588c-4da6-41d3-842a-686517438c19 req-264838bf-bc36-498e-9686-b974cbbe97f4 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5df8588c-4da6-41d3-842a-686517438c19 req-264838bf-bc36-498e-9686-b974cbbe97f4 service nova] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5df8588c-4da6-41d3-842a-686517438c19 req-264838bf-bc36-498e-9686-b974cbbe97f4 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5df8588c-4da6-41d3-842a-686517438c19 req-264838bf-bc36-498e-9686-b974cbbe97f4 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-5df8588c-4da6-41d3-842a-686517438c19 req-264838bf-bc36-498e-9686-b974cbbe97f4 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] No waiting events found dispatching network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:03:05 user nova-compute[70659]: WARNING nova.compute.manager [req-5df8588c-4da6-41d3-842a-686517438c19 req-264838bf-bc36-498e-9686-b974cbbe97f4 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received unexpected event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 for instance with vm_state active and task_state None.
Jul 25 17:03:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0c31d1ed-0675-4d78-aff3-a736f4b99411 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updating instance_info_cache with network_info: [{"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:03:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:03:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:03:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvplyGJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:03:07 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:03:07 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:03:07 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc26a82c-3ba0-4d50-8733-9de76113870e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:03:07 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[01152dad-4faa-4741-ac5e-aca3457fbefb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a] added
Jul 25 17:03:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcededf-8952-4ed2-8fab-9a6f1d7e2069]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[04452450-8e1a-49b7-b9ae-7be24af4bc4b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvplyGJI {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvplyGJI" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[342f36eb-37bc-4cb2-a8c0-ff03254ba315]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvplyGJI'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f887156f-ade4-46b3-aa49-7af4a4c05b57]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1653f9-4921-405d-a2c6-545f1694a21a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea6e9c8-a953-4db1-8ca3-4082f1603b48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a, portal: 172.16.0.220,3260]
Jul 25 17:03:07 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a, portal: 172.16.0.220,3260] successful.
Jul 25 17:03:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11f59fc-aba0-43d6-8a5d-bb211fbdd880]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce9c2f4-d121-4d3e-95eb-83e997e503f6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:03:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:07 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:03:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db3450e-8598-48f0-94e9-519ad39c284d]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:03:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvplyGJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:03:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:03:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23135346238353730', 'path': '/dev/sde'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:03:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135346238353730', 'path': '/dev/sde'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:03:08 user nova-compute[70659]: DEBUG nova.objects.instance [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'flavor' on Instance uuid 77750821-16ee-4945-88ff-a8445edab24b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:03:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:03:08 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:03:08 user nova-compute[70659]:   <source dev="/dev/sde"/>
Jul 25 17:03:08 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:03:08 user nova-compute[70659]:   <serial>16cbb85e-6903-4c84-8d47-85b217f8b05a</serial>
Jul 25 17:03:08 user nova-compute[70659]: </disk>
Jul 25 17:03:08 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:03:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:03:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:03:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No VIF found with MAC fa:16:3e:6a:fb:de, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:03:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8f587d44-d960-4fc8-8ab1-7a998bbbd16b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.769s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "8ea8589f-2203-4057-bf80-92e3f193936e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "8ea8589f-2203-4057-bf80-92e3f193936e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:03:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:13 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:03:13 user nova-compute[70659]: INFO nova.compute.claims [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Claim successful on node user
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304578.906386, c2800889-2d2e-4660-8bc9-f1f1782587d3 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:03:14 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] VM Stopped (Lifecycle Event)
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04ee7f6f-4c37-4246-927f-8e19ff27d108 None None] [instance: c2800889-2d2e-4660-8bc9-f1f1782587d3] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:03:14 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.policy [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e925fbb88b3e433abd27fa08a766e4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ed4eae8755454c9e5be953e69c013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:03:14 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Creating image(s)
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "/opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "/opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.156s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk 1073741824" returned: 0 in 0.060s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:14 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Successfully created port: dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Cannot resize image /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'migration_context' on Instance uuid 8ea8589f-2203-4057-bf80-92e3f193936e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Ensure instance console log exists: /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:15 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Successfully updated port: dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "refresh_cache-8ea8589f-2203-4057-bf80-92e3f193936e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquired lock "refresh_cache-8ea8589f-2203-4057-bf80-92e3f193936e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-f9abe744-f4a7-4c07-9c09-e7fff8599945 req-6cbdf336-4f64-4a55-9f3c-8a317c5c14ea service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received event network-changed-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-f9abe744-f4a7-4c07-9c09-e7fff8599945 req-6cbdf336-4f64-4a55-9f3c-8a317c5c14ea service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Refreshing instance network info cache due to event network-changed-dfc4dc98-da59-4eda-852a-2205abc67304. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9abe744-f4a7-4c07-9c09-e7fff8599945 req-6cbdf336-4f64-4a55-9f3c-8a317c5c14ea service nova] Acquiring lock "refresh_cache-8ea8589f-2203-4057-bf80-92e3f193936e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Updating instance_info_cache with network_info: [{"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Releasing lock "refresh_cache-8ea8589f-2203-4057-bf80-92e3f193936e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Instance network_info: |[{"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9abe744-f4a7-4c07-9c09-e7fff8599945 req-6cbdf336-4f64-4a55-9f3c-8a317c5c14ea service nova] Acquired lock "refresh_cache-8ea8589f-2203-4057-bf80-92e3f193936e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-f9abe744-f4a7-4c07-9c09-e7fff8599945 req-6cbdf336-4f64-4a55-9f3c-8a317c5c14ea service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Refreshing network info cache for port dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Start _get_guest_xml network_info=[{"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:03:16 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:03:16 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-901078322',display_name='tempest-AttachVolumeNegativeTest-server-901078322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-901078322',id=36,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo+rreI7O0H7kEv7TSBQTV6dmlGRKWXlnq6LlvxXHYKFMS/xBxM6Zx8TFO970MHzulEEQxEsg9OKUMiNOmq3NsLtoNCxGuXvs96sxBZSlKrEk14cwue7uIpJuBMMWsMTg==',key_name='tempest-keypair-726800176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-d50n10da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=8ea8589f-2203-4057-bf80-92e3f193936e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:5e:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfc4dc98-da59-4eda-852a-2205abc67304,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc4dc98-da') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ea8589f-2203-4057-bf80-92e3f193936e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:03:16 user nova-compute[70659]:   <uuid>8ea8589f-2203-4057-bf80-92e3f193936e</uuid>
Jul 25 17:03:16 user nova-compute[70659]:   <name>instance-00000024</name>
Jul 25 17:03:16 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:03:16 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:03:16 user nova-compute[70659]:   <metadata>
Jul 25 17:03:16 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:03:16 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:03:16 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeNegativeTest-server-901078322</nova:name>
Jul 25 17:03:16 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:03:16</nova:creationTime>
Jul 25 17:03:16 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:03:16 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:03:16 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:03:16 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:03:16 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:03:16 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:03:16 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:03:16 user nova-compute[70659]:       <nova:owner>
Jul 25 17:03:16 user nova-compute[70659]:         <nova:user uuid="e925fbb88b3e433abd27fa08a766e4e8">tempest-AttachVolumeNegativeTest-921778031-project-member</nova:user>
Jul 25 17:03:16 user nova-compute[70659]:         <nova:project uuid="e5ed4eae8755454c9e5be953e69c013a">tempest-AttachVolumeNegativeTest-921778031</nova:project>
Jul 25 17:03:16 user nova-compute[70659]:       </nova:owner>
Jul 25 17:03:16 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:03:16 user nova-compute[70659]:       <nova:ports>
Jul 25 17:03:16 user nova-compute[70659]:         <nova:port uuid="dfc4dc98-da59-4eda-852a-2205abc67304">
Jul 25 17:03:16 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 17:03:16 user nova-compute[70659]:         </nova:port>
Jul 25 17:03:16 user nova-compute[70659]:       </nova:ports>
Jul 25 17:03:16 user nova-compute[70659]:     </nova:instance>
Jul 25 17:03:16 user nova-compute[70659]:   </metadata>
Jul 25 17:03:16 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:03:16 user nova-compute[70659]:     <system>
Jul 25 17:03:16 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:03:16 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:03:16 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:03:16 user nova-compute[70659]:       <entry name="serial">8ea8589f-2203-4057-bf80-92e3f193936e</entry>
Jul 25 17:03:16 user nova-compute[70659]:       <entry name="uuid">8ea8589f-2203-4057-bf80-92e3f193936e</entry>
Jul 25 17:03:16 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:03:16 user nova-compute[70659]:     </system>
Jul 25 17:03:16 user nova-compute[70659]:   </sysinfo>
Jul 25 17:03:16 user nova-compute[70659]:   <os>
Jul 25 17:03:16 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:03:16 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:03:16 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:03:16 user nova-compute[70659]:   </os>
Jul 25 17:03:16 user nova-compute[70659]:   <features>
Jul 25 17:03:16 user nova-compute[70659]:     <acpi/>
Jul 25 17:03:16 user nova-compute[70659]:     <apic/>
Jul 25 17:03:16 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:03:16 user nova-compute[70659]:   </features>
Jul 25 17:03:16 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:03:16 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:03:16 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:03:16 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:03:16 user nova-compute[70659]:   </clock>
Jul 25 17:03:16 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:03:16 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:03:16 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:03:16 user nova-compute[70659]:   </cpu>
Jul 25 17:03:16 user nova-compute[70659]:   <devices>
Jul 25 17:03:16 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:03:16 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:03:16 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk"/>
Jul 25 17:03:16 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:03:16 user nova-compute[70659]:     </disk>
Jul 25 17:03:16 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:03:16 user nova-compute[70659]:       <mac address="fa:16:3e:89:5e:d3"/>
Jul 25 17:03:16 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:03:16 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:03:16 user nova-compute[70659]:       <target dev="tapdfc4dc98-da"/>
Jul 25 17:03:16 user nova-compute[70659]:     </interface>
Jul 25 17:03:16 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:03:16 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/console.log" append="off"/>
Jul 25 17:03:16 user nova-compute[70659]:     </serial>
Jul 25 17:03:16 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:03:16 user nova-compute[70659]:     <video>
Jul 25 17:03:16 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:03:16 user nova-compute[70659]:     </video>
Jul 25 17:03:16 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:03:16 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:03:16 user nova-compute[70659]:     </rng>
Jul 25 17:03:16 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:03:16 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:03:16 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:03:16 user nova-compute[70659]:     </memballoon>
Jul 25 17:03:16 user nova-compute[70659]:   </devices>
Jul 25 17:03:16 user nova-compute[70659]: </domain>
Jul 25 17:03:16 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-901078322',display_name='tempest-AttachVolumeNegativeTest-server-901078322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-901078322',id=36,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo+rreI7O0H7kEv7TSBQTV6dmlGRKWXlnq6LlvxXHYKFMS/xBxM6Zx8TFO970MHzulEEQxEsg9OKUMiNOmq3NsLtoNCxGuXvs96sxBZSlKrEk14cwue7uIpJuBMMWsMTg==',key_name='tempest-keypair-726800176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-d50n10da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=8ea8589f-2203-4057-bf80-92e3f193936e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:5e:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfc4dc98-da59-4eda-852a-2205abc67304,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc4dc98-da') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG os_vif [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5e:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfc4dc98-da59-4eda-852a-2205abc67304,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc4dc98-da') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfc4dc98-da, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfc4dc98-da, col_values=(('external_ids', {'iface-id': 'dfc4dc98-da59-4eda-852a-2205abc67304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:5e:d3', 'vm-uuid': '8ea8589f-2203-4057-bf80-92e3f193936e'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:16 user nova-compute[70659]: INFO os_vif [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5e:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfc4dc98-da59-4eda-852a-2205abc67304,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc4dc98-da')
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No VIF found with MAC fa:16:3e:89:5e:d3, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-f9abe744-f4a7-4c07-9c09-e7fff8599945 req-6cbdf336-4f64-4a55-9f3c-8a317c5c14ea service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Updated VIF entry in instance network info cache for port dfc4dc98-da59-4eda-852a-2205abc67304. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-f9abe744-f4a7-4c07-9c09-e7fff8599945 req-6cbdf336-4f64-4a55-9f3c-8a317c5c14ea service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Updating instance_info_cache with network_info: [{"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:03:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9abe744-f4a7-4c07-9c09-e7fff8599945 req-6cbdf336-4f64-4a55-9f3c-8a317c5c14ea service nova] Releasing lock "refresh_cache-8ea8589f-2203-4057-bf80-92e3f193936e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:03:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-814abbb1-b94b-47b3-9900-4989b70587ac req-adaf3f78-ed7c-48d2-8eeb-80c8b9752fc6 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received event network-vif-plugged-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:03:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-814abbb1-b94b-47b3-9900-4989b70587ac req-adaf3f78-ed7c-48d2-8eeb-80c8b9752fc6 service nova] Acquiring lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-814abbb1-b94b-47b3-9900-4989b70587ac req-adaf3f78-ed7c-48d2-8eeb-80c8b9752fc6 service nova] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-814abbb1-b94b-47b3-9900-4989b70587ac req-adaf3f78-ed7c-48d2-8eeb-80c8b9752fc6 service nova] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-814abbb1-b94b-47b3-9900-4989b70587ac req-adaf3f78-ed7c-48d2-8eeb-80c8b9752fc6 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] No waiting events found dispatching network-vif-plugged-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:03:18 user nova-compute[70659]: WARNING nova.compute.manager [req-814abbb1-b94b-47b3-9900-4989b70587ac req-adaf3f78-ed7c-48d2-8eeb-80c8b9752fc6 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received unexpected event network-vif-plugged-dfc4dc98-da59-4eda-852a-2205abc67304 for instance with vm_state building and task_state spawning.
Jul 25 17:03:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304600.2262142, 8ea8589f-2203-4057-bf80-92e3f193936e => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:03:20 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] VM Resumed (Lifecycle Event)
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-16eaac68-968e-4c8e-b150-8f0ea56781fa req-b0724aa2-62e0-4d0f-b535-623b55f7bf1d service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received event network-vif-plugged-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-16eaac68-968e-4c8e-b150-8f0ea56781fa req-b0724aa2-62e0-4d0f-b535-623b55f7bf1d service nova] Acquiring lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-16eaac68-968e-4c8e-b150-8f0ea56781fa req-b0724aa2-62e0-4d0f-b535-623b55f7bf1d service nova] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-16eaac68-968e-4c8e-b150-8f0ea56781fa req-b0724aa2-62e0-4d0f-b535-623b55f7bf1d service nova] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-16eaac68-968e-4c8e-b150-8f0ea56781fa req-b0724aa2-62e0-4d0f-b535-623b55f7bf1d service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] No waiting events found dispatching network-vif-plugged-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:03:20 user nova-compute[70659]: WARNING nova.compute.manager [req-16eaac68-968e-4c8e-b150-8f0ea56781fa req-b0724aa2-62e0-4d0f-b535-623b55f7bf1d service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received unexpected event network-vif-plugged-dfc4dc98-da59-4eda-852a-2205abc67304 for instance with vm_state building and task_state spawning.
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:03:20 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Instance spawned successfully.
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:03:20 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304600.5808878, 8ea8589f-2203-4057-bf80-92e3f193936e => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:03:20 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] VM Started (Lifecycle Event)
Jul 25 17:03:20 user nova-compute[70659]: INFO nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Took 6.11 seconds to spawn the instance on the hypervisor.
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:03:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:03:20 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:03:20 user nova-compute[70659]: INFO nova.compute.manager [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Took 6.84 seconds to build instance.
Jul 25 17:03:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4263f5b4-ed97-4134-8ab1-8a7b1a5a936b tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "8ea8589f-2203-4057-bf80-92e3f193936e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.950s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-d4cd08e3-8f8f-4d2f-b6a7-e41655d01126 req-827e7ecf-ea17-40cd-a190-9843dad1696f service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received event network-changed-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:03:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-d4cd08e3-8f8f-4d2f-b6a7-e41655d01126 req-827e7ecf-ea17-40cd-a190-9843dad1696f service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Refreshing instance network info cache due to event network-changed-c3f11e4b-8894-4a84-a443-7f77a930fcc6. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:03:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4cd08e3-8f8f-4d2f-b6a7-e41655d01126 req-827e7ecf-ea17-40cd-a190-9843dad1696f service nova] Acquiring lock "refresh_cache-6bad1ca0-56cf-4a8d-b86c-adb41383e656" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:03:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4cd08e3-8f8f-4d2f-b6a7-e41655d01126 req-827e7ecf-ea17-40cd-a190-9843dad1696f service nova] Acquired lock "refresh_cache-6bad1ca0-56cf-4a8d-b86c-adb41383e656" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:03:32 user nova-compute[70659]: DEBUG nova.network.neutron [req-d4cd08e3-8f8f-4d2f-b6a7-e41655d01126 req-827e7ecf-ea17-40cd-a190-9843dad1696f service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Refreshing network info cache for port c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:03:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:32 user nova-compute[70659]: DEBUG nova.network.neutron [req-d4cd08e3-8f8f-4d2f-b6a7-e41655d01126 req-827e7ecf-ea17-40cd-a190-9843dad1696f service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Updated VIF entry in instance network info cache for port c3f11e4b-8894-4a84-a443-7f77a930fcc6. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:03:32 user nova-compute[70659]: DEBUG nova.network.neutron [req-d4cd08e3-8f8f-4d2f-b6a7-e41655d01126 req-827e7ecf-ea17-40cd-a190-9843dad1696f service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Updating instance_info_cache with network_info: [{"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:03:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4cd08e3-8f8f-4d2f-b6a7-e41655d01126 req-827e7ecf-ea17-40cd-a190-9843dad1696f service nova] Releasing lock "refresh_cache-6bad1ca0-56cf-4a8d-b86c-adb41383e656" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG nova.objects.instance [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lazy-loading 'flavor' on Instance uuid 6bad1ca0-56cf-4a8d-b86c-adb41383e656 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:36 user nova-compute[70659]: INFO nova.compute.manager [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Attaching volume 0181a64b-bc5b-40de-aa06-84db4579e380 to /dev/vdb
Jul 25 17:03:36 user nova-compute[70659]: DEBUG os_brick.utils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f3c17c-d211-4ba3-9df9-9a79a6f9e135]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[28784b85-cb99-4bb4-8f07-dd3c22683ce4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3688423-5320-4eb3-82e7-8400a030aeb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3d0df6-dcce-4099-9476-29e6ad5dab44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:03:36 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:03:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecab859-bd2c-4278-a144-0b1875d65135]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG os_brick.utils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:03:36 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Updating existing volume attachment record: c2cc8ac9-d3c4-483d-bf58-0ecfce058934 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:03:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvJEwWlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:03:43 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:03:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:03:43 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:03:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:03:43 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:03:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7977eb6-a5f5-4dd3-9dc0-73044c865cf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:03:43 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebf0bd7-d3bd-4b56-8364-dc202763f7f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380] added
Jul 25 17:03:43 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9992f20-c169-42f0-ae49-4168a60626b3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbbe202-dfb1-4425-b21a-846c5bd584a7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvJEwWlU {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvJEwWlU" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e491ebc9-7515-4599-99c3-14602f3464cd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvJEwWlU'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6d3162-f520-499f-a1ca-ff6120bf2b21]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee5d2a8-027b-4ad2-8d2b-4b184354b3ad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:03:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:03:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bb466d-8525-4864-a8dd-1ecb570c82ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380, portal: 172.16.0.220,3260]
Jul 25 17:03:44 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380, portal: 172.16.0.220,3260] successful.
Jul 25 17:03:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c37914-18a0-4aad-ab92-6cb79a87571b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e211b76-b4ce-41a6-a0c4-84ae7dc76e0b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:03:44 user nova-compute[70659]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 (non-flash)
Jul 25 17:03:44 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ec271e-63bb-4ea9-9050-37d1600c8338]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvJEwWlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:03:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23732646538373532', 'path': '/dev/sdf'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:03:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732646538373532', 'path': '/dev/sdf'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:03:45 user nova-compute[70659]: DEBUG nova.objects.instance [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lazy-loading 'flavor' on Instance uuid 6bad1ca0-56cf-4a8d-b86c-adb41383e656 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:03:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:03:45 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:03:45 user nova-compute[70659]:   <source dev="/dev/sdf"/>
Jul 25 17:03:45 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:03:45 user nova-compute[70659]:   <serial>0181a64b-bc5b-40de-aa06-84db4579e380</serial>
Jul 25 17:03:45 user nova-compute[70659]: </disk>
Jul 25 17:03:45 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:03:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:03:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:03:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] No VIF found with MAC fa:16:3e:dc:64:14, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:03:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-37c774f1-82da-4553-bf4e-c146e5685100 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.173s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:48 user nova-compute[70659]: INFO nova.compute.manager [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Detaching volume 0181a64b-bc5b-40de-aa06-84db4579e380
Jul 25 17:03:48 user nova-compute[70659]: INFO nova.virt.block_device [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Attempting to driver detach volume 0181a64b-bc5b-40de-aa06-84db4579e380 from mountpoint /dev/vdb
Jul 25 17:03:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Attempting to detach device vdb from instance 6bad1ca0-56cf-4a8d-b86c-adb41383e656 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:03:48 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:03:48 user nova-compute[70659]:   <source dev="/dev/sdf"/>
Jul 25 17:03:48 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:03:48 user nova-compute[70659]:   <serial>0181a64b-bc5b-40de-aa06-84db4579e380</serial>
Jul 25 17:03:48 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:03:48 user nova-compute[70659]: </disk>
Jul 25 17:03:48 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:03:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Successfully detached device vdb from instance 6bad1ca0-56cf-4a8d-b86c-adb41383e656 from the persistent domain config.
Jul 25 17:03:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6bad1ca0-56cf-4a8d-b86c-adb41383e656 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:03:48 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:03:48 user nova-compute[70659]:   <source dev="/dev/sdf"/>
Jul 25 17:03:48 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:03:48 user nova-compute[70659]:   <serial>0181a64b-bc5b-40de-aa06-84db4579e380</serial>
Jul 25 17:03:48 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:03:48 user nova-compute[70659]: </disk>
Jul 25 17:03:48 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304628.8621628, 6bad1ca0-56cf-4a8d-b86c-adb41383e656 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6bad1ca0-56cf-4a8d-b86c-adb41383e656 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:03:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Successfully detached device vdb from instance 6bad1ca0-56cf-4a8d-b86c-adb41383e656 from the live domain config.
Jul 25 17:03:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvJEwWlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:03:48 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d49c70-5916-42b2-a738-f2e73ae24375]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd9d1a3-975b-4103-b449-2e3292eeccea]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:48 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:48 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:48 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:03:48 user nova-compute[70659]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 (non-flash)
Jul 25 17:03:48 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:03:48 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:03:48 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:03:48 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:03:48 user nova-compute[70659]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 (non-flash)
Jul 25 17:03:48 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd28284160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380'): ({'sdf'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Removing single pathed devices sdf {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d43b28-5f64-43d8-a3d9-9487c16858ed]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0c926a-e5d4-4e3a-80e2-4a2a0fa6ff57]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Flushing IO for device /dev/sdf {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[09606975-6a1c-4758-a810-21f438ffbd76]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:03:48 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a6c0e-7ec3-4e62-9b93-1db1a8a6aafe]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd738502-75b8-425e-9c02-fd948fc62621]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b7e211-0037-44aa-a54d-176d8302d323]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380, portal: 172.16.0.220,3260]
Jul 25 17:03:49 user nova-compute[70659]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380, portal: 172.16.0.220,3260] successful.
Jul 25 17:03:49 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0181a64b-bc5b-40de-aa06-84db4579e380 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[131a9d2e-2f63-46dd-bd20-3105f2f58db2]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] <== disconnect_volume: return (282ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG nova.objects.instance [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lazy-loading 'flavor' on Instance uuid 6bad1ca0-56cf-4a8d-b86c-adb41383e656 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:03:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-55184254-c6a4-4a5a-9aab-4e9cef6c56af tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.622s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:03:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:03:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:03:59 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:00 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:04:00 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:04:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7660MB free_disk=25.086570739746094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e006724d-e45a-405f-9084-544925aaa8ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 77750821-16ee-4945-88ff-a8445edab24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 6bad1ca0-56cf-4a8d-b86c-adb41383e656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 856974f4-fd81-4d22-a316-5e08c36e35d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 8ea8589f-2203-4057-bf80-92e3f193936e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:04:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:04:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updating instance_info_cache with network_info: [{"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-73980900-2093-4338-8460-d91df2e2709d" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:04:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:04:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'flavor' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:12 user nova-compute[70659]: INFO nova.compute.manager [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Attaching volume 7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 to /dev/vdb
Jul 25 17:04:12 user nova-compute[70659]: DEBUG os_brick.utils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c55b8-d56f-4ea4-824c-1523b8101034]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4335d7-4e68-4b26-ab9c-8ef82f1c1587]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ef1603-54f7-416f-bbc6-2209e5d6750f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[396aa167-bd3a-4fe6-b895-5b19a543e0b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:04:12 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:04:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a90755-2bf6-43f6-b573-9d8a103ab3ba]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG os_brick.utils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:04:12 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating existing volume attachment record: 858e9a48-7f70-4e8f-9379-d91fa95155da {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:04:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgCjPSea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:04:19 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:04:19 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:04:19 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[661c9d70-f002-472c-830b-55a4cc736aab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:04:19 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68d24a2-46ec-41d2-9dec-91cee6a9afce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4] added
Jul 25 17:04:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5453973e-3077-4df7-8a4d-a54f650ce87b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8dce90-cf95-4392-b39f-c061523c3d15]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgCjPSea {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgCjPSea" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c36116-7905-4974-82ae-73329e8c27c0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WgCjPSea'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff91237-8200-4cf5-8861-942207b438ac]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4bb315-1875-4567-a420-7178efb5aca6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[330e8830-b685-46e8-9566-608a041e87bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260]
Jul 25 17:04:19 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260] successful.
Jul 25 17:04:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[703e996b-0c16-4cfb-a65a-3447f115feb4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d75ca0-cf91-40ce-9535-38992acd1c14]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:19 user nova-compute[70659]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:04:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3a805d-4064-4d61-bf78-b118f8ba753c]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:19 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:04:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:04:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgCjPSea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:04:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:04:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23663373962663039', 'path': '/dev/sdf'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:04:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663373962663039', 'path': '/dev/sdf'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:04:20 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'flavor' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:04:20 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:04:20 user nova-compute[70659]:   <source dev="/dev/sdf"/>
Jul 25 17:04:20 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:04:20 user nova-compute[70659]:   <serial>7b1bd297-453d-4dd7-bb82-b4ba3624a9b4</serial>
Jul 25 17:04:20 user nova-compute[70659]: </disk>
Jul 25 17:04:20 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No VIF found with MAC fa:16:3e:66:54:bd, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7c603db7-ca16-45fd-9774-1156835b60ae tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.981s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:04:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:04:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:04:28 user nova-compute[70659]: INFO nova.compute.manager [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Rescuing
Jul 25 17:04:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:04:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquired lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:04:28 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Updating instance_info_cache with network_info: [{"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Releasing lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-790f62cf-94f4-4916-918a-5e5f931f880b req-7876e12c-8fa4-4386-ad87-c6c10ed1c140 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-790f62cf-94f4-4916-918a-5e5f931f880b req-7876e12c-8fa4-4386-ad87-c6c10ed1c140 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing instance network info cache due to event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-790f62cf-94f4-4916-918a-5e5f931f880b req-7876e12c-8fa4-4386-ad87-c6c10ed1c140 service nova] Acquiring lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-790f62cf-94f4-4916-918a-5e5f931f880b req-7876e12c-8fa4-4386-ad87-c6c10ed1c140 service nova] Acquired lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG nova.network.neutron [req-790f62cf-94f4-4916-918a-5e5f931f880b req-7876e12c-8fa4-4386-ad87-c6c10ed1c140 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Instance destroyed successfully.
Jul 25 17:04:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Attempting a stable device rescue
Jul 25 17:04:30 user nova-compute[70659]: DEBUG nova.network.neutron [req-790f62cf-94f4-4916-918a-5e5f931f880b req-7876e12c-8fa4-4386-ad87-c6c10ed1c140 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updated VIF entry in instance network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG nova.network.neutron [req-790f62cf-94f4-4916-918a-5e5f931f880b req-7876e12c-8fa4-4386-ad87-c6c10ed1c140 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating instance_info_cache with network_info: [{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-790f62cf-94f4-4916-918a-5e5f931f880b req-7876e12c-8fa4-4386-ad87-c6c10ed1c140 service nova] Releasing lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70659) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Instance directory exists: not creating {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 17:04:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Creating image(s)
Jul 25 17:04:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "/opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "/opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "/opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'trusted_certs' on Instance uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "09ca8dba802a50cd580e38f52009aa90e0cfb019" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "09ca8dba802a50cd580e38f52009aa90e0cfb019" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:31 user nova-compute[70659]: WARNING nova.compute.manager [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state active and task_state rescuing.
Jul 25 17:04:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:31 user nova-compute[70659]: WARNING nova.compute.manager [req-c96f8383-2575-40c7-84ba-10ef840fdcfa req-90129253-5456-494d-a75c-51cf2ce61996 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state active and task_state rescuing.
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019.part --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG nova.virt.images [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] 040364eb-3a38-463e-8e66-030be9829d61 was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019.part /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-bc676a23-8ee2-4a6c-b99c-7c7ad14a8a87 req-7e0d78b2-0a28-467a-a60e-22723188a724 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-bc676a23-8ee2-4a6c-b99c-7c7ad14a8a87 req-7e0d78b2-0a28-467a-a60e-22723188a724 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing instance network info cache due to event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bc676a23-8ee2-4a6c-b99c-7c7ad14a8a87 req-7e0d78b2-0a28-467a-a60e-22723188a724 service nova] Acquiring lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bc676a23-8ee2-4a6c-b99c-7c7ad14a8a87 req-7e0d78b2-0a28-467a-a60e-22723188a724 service nova] Acquired lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:04:31 user nova-compute[70659]: DEBUG nova.network.neutron [req-bc676a23-8ee2-4a6c-b99c-7c7ad14a8a87 req-7e0d78b2-0a28-467a-a60e-22723188a724 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019.part /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019.converted" returned: 0 in 0.503s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "09ca8dba802a50cd580e38f52009aa90e0cfb019" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.921s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "09ca8dba802a50cd580e38f52009aa90e0cfb019" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "09ca8dba802a50cd580e38f52009aa90e0cfb019" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019 --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019,backing_fmt=raw /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019,backing_fmt=raw /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue" returned: 0 in 0.060s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "09ca8dba802a50cd580e38f52009aa90e0cfb019" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'migration_context' on Instance uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Start _get_guest_xml network_info=[{"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "vif_mac": "fa:16:3e:f8:b1:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '040364eb-3a38-463e-8e66-030be9829d61', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '06c72e84-84b3-4893-8fbb-34fad2e7ad6e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPoCRjte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '856974f4-fd81-4d22-a316-5e08c36e35d6', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd765297-1ef5-4ad5-81e4-d5548b2d080a', 'serial': 'fd765297-1ef5-4ad5-81e4-d5548b2d080a'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'resources' on Instance uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'numa_topology' on Instance uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:32 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:04:32 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'vcpu_model' on Instance uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPoCRjte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:04:32 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:04:32 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:04:32 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5980383c-c2cf-47ac-be6b-0a8f2fbc5446]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DPoCRjte\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 25 17:04:32 user nova-compute[70659]: node.name = iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a
Jul 25 17:04:32 user nova-compute[70659]: node.tpgt = -1
Jul 25 17:04:32 user nova-compute[70659]: node.startup = automatic
Jul 25 17:04:32 user nova-compute[70659]: node.leading_login = No
Jul 25 17:04:32 user nova-compute[70659]: iface.iscsi_ifacename = default
Jul 25 17:04:32 user nova-compute[70659]: iface.net_ifacename = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.ipaddress = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.prefix_len = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.hwaddress = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.transport_name = tcp
Jul 25 17:04:32 user nova-compute[70659]: iface.initiatorname = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.state = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.vlan_id = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.vlan_priority = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.vlan_state = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.iface_num = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.mtu = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.port = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.bootproto = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.subnet_mask = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.gateway = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.dhcp_alt_client_id_state = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.dhcp_alt_client_id = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.dhcp_dns = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.dhcp_learn_iqn = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.dhcp_req_vendor_id_state = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.dhcp_vendor_id_state = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.dhcp_vendor_id = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.dhcp_slp_da = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.fragmentation = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.gratuitous_arp = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.incoming_forwarding = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.tos_state = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.tos = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.ttl = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.delayed_ack = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.tcp_nagle = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.tcp_wsf_state = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.tcp_wsf = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.tcp_timer_scale = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.tcp_timestamp = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.redirect = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.def_task_mgmt_timeout = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.header_digest = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.data_digest = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.immediate_data = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.initial_r2t = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.data_seq_inorder = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.data_pdu_inorder = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.erl = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.max_receive_data_len = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.first_burst_len = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.max_outstanding_r2t = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.max_burst_len = 0
Jul 25 17:04:32 user nova-compute[70659]: iface.chap_auth = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.bidi_chap = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.strict_login_compliance = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.discovery_auth = <empty>
Jul 25 17:04:32 user nova-compute[70659]: iface.discovery_logout = <empty>
Jul 25 17:04:32 user nova-compute[70659]: node.discovery_address = <empty>
Jul 25 17:04:32 user nova-compute[70659]: node.discovery_port = 0
Jul 25 17:04:32 user nova-compute[70659]: node.discovery_type = static
Jul 25 17:04:32 user nova-compute[70659]: node.session.initial_cmdsn = 0
Jul 25 17:04:32 user nova-compute[70659]: node.session.initial_login_retry_max = 8
Jul 25 17:04:32 user nova-compute[70659]: node.session.xmit_thread_priority = -20
Jul 25 17:04:32 user nova-compute[70659]: node.session.cmds_max = 128
Jul 25 17:04:32 user nova-compute[70659]: node.session.queue_depth = 32
Jul 25 17:04:32 user nova-compute[70659]: node.session.nr_sessions = 1
Jul 25 17:04:32 user nova-compute[70659]: node.session.auth.authmethod = CHAP
Jul 25 17:04:32 user nova-compute[70659]: node.session.auth.username = DPoCRjte
Jul 25 17:04:32 user nova-compute[70659]: node.session.auth.password = ***
Jul 25 17:04:32 user nova-compute[70659]: node.session.auth.username_in = <empty>
Jul 25 17:04:32 user nova-compute[70659]: node.session.auth.password_in = <empty>
Jul 25 17:04:32 user nova-compute[70659]: node.session.auth.chap_algs = MD5
Jul 25 17:04:32 user nova-compute[70659]: node.session.timeo.replacement_timeout = 120
Jul 25 17:04:32 user nova-compute[70659]: node.session.err_timeo.abort_timeout = 15
Jul 25 17:04:32 user nova-compute[70659]: node.session.err_timeo.lu_reset_timeout = 30
Jul 25 17:04:32 user nova-compute[70659]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 25 17:04:32 user nova-compute[70659]: node.session.err_timeo.host_reset_timeout = 60
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.FastAbort = Yes
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.InitialR2T = No
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.ImmediateData = Yes
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.FirstBurstLength = 262144
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.MaxBurstLength = 16776192
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.DefaultTime2Retain = 0
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.DefaultTime2Wait = 2
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.MaxConnections = 1
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 25 17:04:32 user nova-compute[70659]: node.session.iscsi.ERL = 0
Jul 25 17:04:32 user nova-compute[70659]: node.session.scan = manual
Jul 25 17:04:32 user nova-compute[70659]: node.session.reopen_max = 0
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].address = 172.16.0.220
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].port = 3260
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].startup = manual
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].tcp.window_size = 524288
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].tcp.type_of_service = 0
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].timeo.logout_timeout = 15
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].timeo.login_timeout = 15
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].timeo.auth_timeout = 45
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].timeo.noop_out_interval = 5
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].timeo.noop_out_timeout = 5
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].iscsi.HeaderDigest = None
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].iscsi.DataDigest = None
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].iscsi.IFMarker = No
Jul 25 17:04:32 user nova-compute[70659]: node.conn[0].iscsi.OFMarker = No
Jul 25 17:04:32 user nova-compute[70659]: # END RECORD
Jul 25 17:04:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9073111c-d16f-4e10-8baa-d858d086028d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.network.neutron [req-bc676a23-8ee2-4a6c-b99c-7c7ad14a8a87 req-7e0d78b2-0a28-467a-a60e-22723188a724 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updated VIF entry in instance network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.network.neutron [req-bc676a23-8ee2-4a6c-b99c-7c7ad14a8a87 req-7e0d78b2-0a28-467a-a60e-22723188a724 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating instance_info_cache with network_info: [{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bc676a23-8ee2-4a6c-b99c-7c7ad14a8a87 req-7e0d78b2-0a28-467a-a60e-22723188a724 service nova] Releasing lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee2f4a9-6fe4-4617-bcc7-85cea3af5f85]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPoCRjte {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPoCRjte" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6d7da7-ac20-40b8-9a4c-0a056adcc7fc]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DPoCRjte'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d00e276-55ee-4d55-8724-559c7aa73e5d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1806d0ae-c746-4304-acf3-b9afa145e5a5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:32 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:32 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:32 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:32 user nova-compute[70659]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:04:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:32 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:32 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:32 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:32 user nova-compute[70659]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:04:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] HCTL ('33', '0', '0', 0) found on session 38 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fb0b24-b05e-45f4-a94f-1aeb78dda4fb]: (4, ('0 0 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Searching for a device in session 38 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPoCRjte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '26166383638383839', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166383638383839', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1495572339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1495572339',id=35,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-llo3qz24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:02:57Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=856974f4-fd81-4d22-a316-5e08c36e35d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "vif_mac": "fa:16:3e:f8:b1:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "vif_mac": "fa:16:3e:f8:b1:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:b1:ff,bridge_name='br-int',has_traffic_filtering=True,id=69c79a6b-1381-4a30-bf75-896997767587,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c79a6b-13') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'pci_devices' on Instance uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:04:32 user nova-compute[70659]:   <uuid>856974f4-fd81-4d22-a316-5e08c36e35d6</uuid>
Jul 25 17:04:32 user nova-compute[70659]:   <name>instance-00000023</name>
Jul 25 17:04:32 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:04:32 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:04:32 user nova-compute[70659]:   <metadata>
Jul 25 17:04:32 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:04:32 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:04:32 user nova-compute[70659]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1495572339</nova:name>
Jul 25 17:04:32 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:04:32</nova:creationTime>
Jul 25 17:04:32 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:04:32 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:04:32 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:04:32 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:04:32 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:04:32 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:04:32 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:04:32 user nova-compute[70659]:       <nova:owner>
Jul 25 17:04:32 user nova-compute[70659]:         <nova:user uuid="913d51a0ff3746c5bdadd59fdf14e787">tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member</nova:user>
Jul 25 17:04:32 user nova-compute[70659]:         <nova:project uuid="1ef5ee6f08d04772994840a8973da621">tempest-ServerBootFromVolumeStableRescueTest-191665891</nova:project>
Jul 25 17:04:32 user nova-compute[70659]:       </nova:owner>
Jul 25 17:04:32 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:04:32 user nova-compute[70659]:       <nova:ports>
Jul 25 17:04:32 user nova-compute[70659]:         <nova:port uuid="69c79a6b-1381-4a30-bf75-896997767587">
Jul 25 17:04:32 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 17:04:32 user nova-compute[70659]:         </nova:port>
Jul 25 17:04:32 user nova-compute[70659]:       </nova:ports>
Jul 25 17:04:32 user nova-compute[70659]:     </nova:instance>
Jul 25 17:04:32 user nova-compute[70659]:   </metadata>
Jul 25 17:04:32 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:04:32 user nova-compute[70659]:     <system>
Jul 25 17:04:32 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:04:32 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:04:32 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:04:32 user nova-compute[70659]:       <entry name="serial">856974f4-fd81-4d22-a316-5e08c36e35d6</entry>
Jul 25 17:04:32 user nova-compute[70659]:       <entry name="uuid">856974f4-fd81-4d22-a316-5e08c36e35d6</entry>
Jul 25 17:04:32 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:04:32 user nova-compute[70659]:     </system>
Jul 25 17:04:32 user nova-compute[70659]:   </sysinfo>
Jul 25 17:04:32 user nova-compute[70659]:   <os>
Jul 25 17:04:32 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:04:32 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:04:32 user nova-compute[70659]:   </os>
Jul 25 17:04:32 user nova-compute[70659]:   <features>
Jul 25 17:04:32 user nova-compute[70659]:     <acpi/>
Jul 25 17:04:32 user nova-compute[70659]:     <apic/>
Jul 25 17:04:32 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:04:32 user nova-compute[70659]:   </features>
Jul 25 17:04:32 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:04:32 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:04:32 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:04:32 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:04:32 user nova-compute[70659]:   </clock>
Jul 25 17:04:32 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:04:32 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:04:32 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:04:32 user nova-compute[70659]:   </cpu>
Jul 25 17:04:32 user nova-compute[70659]:   <devices>
Jul 25 17:04:32 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:04:32 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:04:32 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 17:04:32 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:04:32 user nova-compute[70659]:       <serial>fd765297-1ef5-4ad5-81e4-d5548b2d080a</serial>
Jul 25 17:04:32 user nova-compute[70659]:     </disk>
Jul 25 17:04:32 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:04:32 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:04:32 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue"/>
Jul 25 17:04:32 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 17:04:32 user nova-compute[70659]:       <boot order="1"/>
Jul 25 17:04:32 user nova-compute[70659]:     </disk>
Jul 25 17:04:32 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:04:32 user nova-compute[70659]:       <mac address="fa:16:3e:f8:b1:ff"/>
Jul 25 17:04:32 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:04:32 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:04:32 user nova-compute[70659]:       <target dev="tap69c79a6b-13"/>
Jul 25 17:04:32 user nova-compute[70659]:     </interface>
Jul 25 17:04:32 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:04:32 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/console.log" append="off"/>
Jul 25 17:04:32 user nova-compute[70659]:     </serial>
Jul 25 17:04:32 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:04:32 user nova-compute[70659]:     <video>
Jul 25 17:04:32 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:04:32 user nova-compute[70659]:     </video>
Jul 25 17:04:32 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:04:32 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:04:32 user nova-compute[70659]:     </rng>
Jul 25 17:04:32 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:04:32 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:04:32 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:04:32 user nova-compute[70659]:     </memballoon>
Jul 25 17:04:32 user nova-compute[70659]:   </devices>
Jul 25 17:04:32 user nova-compute[70659]: </domain>
Jul 25 17:04:32 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:04:32 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Instance destroyed successfully.
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:04:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] No VIF found with MAC fa:16:3e:f8:b1:ff, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-65ae16f0-577c-418e-a69b-5aba5c5e8c1c req-80044b87-2bbd-456f-8fcb-84da376c83cb service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-65ae16f0-577c-418e-a69b-5aba5c5e8c1c req-80044b87-2bbd-456f-8fcb-84da376c83cb service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-65ae16f0-577c-418e-a69b-5aba5c5e8c1c req-80044b87-2bbd-456f-8fcb-84da376c83cb service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-65ae16f0-577c-418e-a69b-5aba5c5e8c1c req-80044b87-2bbd-456f-8fcb-84da376c83cb service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-65ae16f0-577c-418e-a69b-5aba5c5e8c1c req-80044b87-2bbd-456f-8fcb-84da376c83cb service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:34 user nova-compute[70659]: WARNING nova.compute.manager [req-65ae16f0-577c-418e-a69b-5aba5c5e8c1c req-80044b87-2bbd-456f-8fcb-84da376c83cb service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state active and task_state rescuing.
Jul 25 17:04:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:36 user nova-compute[70659]: INFO nova.compute.manager [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Rebooting instance
Jul 25 17:04:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquired lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating instance_info_cache with network_info: [{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Releasing lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-bdcc043d-84c5-497a-83c6-7dd5f202d432 req-19a02b19-0cb4-4c59-bad2-9a45c3a91a91 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bdcc043d-84c5-497a-83c6-7dd5f202d432 req-19a02b19-0cb4-4c59-bad2-9a45c3a91a91 service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bdcc043d-84c5-497a-83c6-7dd5f202d432 req-19a02b19-0cb4-4c59-bad2-9a45c3a91a91 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bdcc043d-84c5-497a-83c6-7dd5f202d432 req-19a02b19-0cb4-4c59-bad2-9a45c3a91a91 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-bdcc043d-84c5-497a-83c6-7dd5f202d432 req-19a02b19-0cb4-4c59-bad2-9a45c3a91a91 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:36 user nova-compute[70659]: WARNING nova.compute.manager [req-bdcc043d-84c5-497a-83c6-7dd5f202d432 req-19a02b19-0cb4-4c59-bad2-9a45c3a91a91 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state active and task_state rescuing.
Jul 25 17:04:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for 856974f4-fd81-4d22-a316-5e08c36e35d6 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304676.9469798, 856974f4-fd81-4d22-a316-5e08c36e35d6 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:04:36 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] VM Resumed (Lifecycle Event)
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1cc608ed-7342-4c64-88c8-91a155a54142 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:04:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:04:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304676.9483051, 856974f4-fd81-4d22-a316-5e08c36e35d6 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:04:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] VM Started (Lifecycle Event)
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-84a3f99c-25e5-4a4c-bfd6-9a099f43c843 req-18992c76-3d71-424e-8925-94f12b427999 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-unplugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84a3f99c-25e5-4a4c-bfd6-9a099f43c843 req-18992c76-3d71-424e-8925-94f12b427999 service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84a3f99c-25e5-4a4c-bfd6-9a099f43c843 req-18992c76-3d71-424e-8925-94f12b427999 service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-84a3f99c-25e5-4a4c-bfd6-9a099f43c843 req-18992c76-3d71-424e-8925-94f12b427999 service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-84a3f99c-25e5-4a4c-bfd6-9a099f43c843 req-18992c76-3d71-424e-8925-94f12b427999 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-unplugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:37 user nova-compute[70659]: WARNING nova.compute.manager [req-84a3f99c-25e5-4a4c-bfd6-9a099f43c843 req-18992c76-3d71-424e-8925-94f12b427999 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received unexpected event network-vif-unplugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with vm_state active and task_state reboot_started_hard.
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:37 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Instance destroyed successfully.
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.objects.instance [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'resources' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1276348519',display_name='tempest-TestMinimumBasicScenario-server-1276348519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1276348519',id=34,image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP7iY75WewGd9w81yWLG0+aApzmPP1DdnbLIGJQjie10aI09rJyALWMwmNsSC+MotNHXs0rY3nOs6ehU+vvWvLRQsTX4H6VMaF2oCf/W+ixdSGtoMeVNIXKH6grRAXuEg==',key_name='tempest-TestMinimumBasicScenario-342159585',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='775d6e7c342a492f815f2c68c62b291a',ramdisk_id='',reservation_id='r-kqj3kgb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-866741703',owner_user_name='tempest-TestMinimumBasicScenario-866741703-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:04:37Z,user_data=None,user_id='b14f37927ee848b890ec02b3068251f3',uuid=a0f3fc7c-0f44-450b-a4c3-f628aad189ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converting VIF {"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_vif [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebdedf5d-69, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:04:37 user nova-compute[70659]: INFO os_vif [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69')
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgCjPSea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:04:37 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3333dde4-1c6c-4357-b58e-ea804eeb8565]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e421e5f1-13ba-4307-9bfe-4a240b3e40d6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:37 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:37 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:37 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:37 user nova-compute[70659]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:04:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:37 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:37 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:37 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:37 user nova-compute[70659]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:04:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd282853f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4'): ({'sdf'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Removing single pathed devices sdf {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[66537325-57aa-49ff-8f17-ad594a7d68e5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ede7e44-560c-4d38-9829-3526ba4fc4d4]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Flushing IO for device /dev/sdf {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead48435-f8aa-42d3-9a06-1edb09e41046]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede2b7c2-b076-40b4-bf25-c862344f02b5]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafb413d-9d18-42f1-aa08-2a82e6bcb086]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e6dd8c-0fe5-49c5-863e-85fc81c65a8a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260]
Jul 25 17:04:37 user nova-compute[70659]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260] successful.
Jul 25 17:04:37 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[855547ab-fc70-41ad-9b5e-a114a4b7c966]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] <== disconnect_volume: return (346ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Start _get_guest_xml network_info=[{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'd716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '858e9a48-7f70-4e8f-9379-d91fa95155da', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgCjPSea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'a0f3fc7c-0f44-450b-a4c3-f628aad189ae', 'attached_at': '', 'detached_at': '', 'volume_id': '7b1bd297-453d-4dd7-bb82-b4ba3624a9b4', 'serial': '7b1bd297-453d-4dd7-bb82-b4ba3624a9b4'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:04:37 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:04:37 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.objects.instance [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:04:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgCjPSea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:04:38 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:04:38 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:04:38 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cde9ad0-3ab2-4a01-8461-5ffe6b5cc814]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:04:38 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec0f797-77a8-4bab-8e09-485ff471771a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4] added
Jul 25 17:04:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac3bb50-5fda-4ca7-ae51-ddc07f5a123a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8369dc9-38f1-43a0-8a94-9d6b64cce601]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgCjPSea {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgCjPSea" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d8f64-9de9-4b96-accd-9ec3d9a1c93a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WgCjPSea'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ba4f2b-1c0c-406b-9939-2abf7ab50ce4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b41b993-ccd9-4d1c-b039-ba216c041892]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[937660bc-7187-4bfa-b507-4d1a4d873c40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260]
Jul 25 17:04:38 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260] successful.
Jul 25 17:04:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.082s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92ed0a6-77cb-42ba-9eff-9080cec05736]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f6555b-0cd2-4d9e-860e-9a4b676600cb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:04:38 user nova-compute[70659]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:04:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[129b4d97-7c9b-4f9d-8e82-c8ef0ed2cf63]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:04:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgCjPSea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-c962fd09-fc2e-45a2-ad56-f7a973c81b96 req-644540d8-edc8-4805-b49f-5e21e626d76d service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c962fd09-fc2e-45a2-ad56-f7a973c81b96 req-644540d8-edc8-4805-b49f-5e21e626d76d service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c962fd09-fc2e-45a2-ad56-f7a973c81b96 req-644540d8-edc8-4805-b49f-5e21e626d76d service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c962fd09-fc2e-45a2-ad56-f7a973c81b96 req-644540d8-edc8-4805-b49f-5e21e626d76d service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-c962fd09-fc2e-45a2-ad56-f7a973c81b96 req-644540d8-edc8-4805-b49f-5e21e626d76d service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:39 user nova-compute[70659]: WARNING nova.compute.manager [req-c962fd09-fc2e-45a2-ad56-f7a973c81b96 req-644540d8-edc8-4805-b49f-5e21e626d76d service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received unexpected event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with vm_state active and task_state reboot_started_hard.
Jul 25 17:04:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23663373962663039', 'path': '/dev/sdf'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663373962663039', 'path': '/dev/sdf'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1276348519',display_name='tempest-TestMinimumBasicScenario-server-1276348519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1276348519',id=34,image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP7iY75WewGd9w81yWLG0+aApzmPP1DdnbLIGJQjie10aI09rJyALWMwmNsSC+MotNHXs0rY3nOs6ehU+vvWvLRQsTX4H6VMaF2oCf/W+ixdSGtoMeVNIXKH6grRAXuEg==',key_name='tempest-TestMinimumBasicScenario-342159585',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='775d6e7c342a492f815f2c68c62b291a',ramdisk_id='',reservation_id='r-kqj3kgb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-866741703',owner_user_name='tempest-TestMinimumBasicScenario-866741703-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:04:37Z,user_data=None,user_id='b14f37927ee848b890ec02b3068251f3',uuid=a0f3fc7c-0f44-450b-a4c3-f628aad189ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converting VIF {"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.objects.instance [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'pci_devices' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:04:39 user nova-compute[70659]:   <uuid>a0f3fc7c-0f44-450b-a4c3-f628aad189ae</uuid>
Jul 25 17:04:39 user nova-compute[70659]:   <name>instance-00000022</name>
Jul 25 17:04:39 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:04:39 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:04:39 user nova-compute[70659]:   <metadata>
Jul 25 17:04:39 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:04:39 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:04:39 user nova-compute[70659]:       <nova:name>tempest-TestMinimumBasicScenario-server-1276348519</nova:name>
Jul 25 17:04:39 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:04:37</nova:creationTime>
Jul 25 17:04:39 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:04:39 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:04:39 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:04:39 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:04:39 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:04:39 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:04:39 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:04:39 user nova-compute[70659]:       <nova:owner>
Jul 25 17:04:39 user nova-compute[70659]:         <nova:user uuid="b14f37927ee848b890ec02b3068251f3">tempest-TestMinimumBasicScenario-866741703-project-member</nova:user>
Jul 25 17:04:39 user nova-compute[70659]:         <nova:project uuid="775d6e7c342a492f815f2c68c62b291a">tempest-TestMinimumBasicScenario-866741703</nova:project>
Jul 25 17:04:39 user nova-compute[70659]:       </nova:owner>
Jul 25 17:04:39 user nova-compute[70659]:       <nova:root type="image" uuid="d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f"/>
Jul 25 17:04:39 user nova-compute[70659]:       <nova:ports>
Jul 25 17:04:39 user nova-compute[70659]:         <nova:port uuid="ebdedf5d-69f8-4141-a81c-301b7347b9c4">
Jul 25 17:04:39 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 17:04:39 user nova-compute[70659]:         </nova:port>
Jul 25 17:04:39 user nova-compute[70659]:       </nova:ports>
Jul 25 17:04:39 user nova-compute[70659]:     </nova:instance>
Jul 25 17:04:39 user nova-compute[70659]:   </metadata>
Jul 25 17:04:39 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:04:39 user nova-compute[70659]:     <system>
Jul 25 17:04:39 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:04:39 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:04:39 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:04:39 user nova-compute[70659]:       <entry name="serial">a0f3fc7c-0f44-450b-a4c3-f628aad189ae</entry>
Jul 25 17:04:39 user nova-compute[70659]:       <entry name="uuid">a0f3fc7c-0f44-450b-a4c3-f628aad189ae</entry>
Jul 25 17:04:39 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:04:39 user nova-compute[70659]:     </system>
Jul 25 17:04:39 user nova-compute[70659]:   </sysinfo>
Jul 25 17:04:39 user nova-compute[70659]:   <os>
Jul 25 17:04:39 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:04:39 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:04:39 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:04:39 user nova-compute[70659]:   </os>
Jul 25 17:04:39 user nova-compute[70659]:   <features>
Jul 25 17:04:39 user nova-compute[70659]:     <acpi/>
Jul 25 17:04:39 user nova-compute[70659]:     <apic/>
Jul 25 17:04:39 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:04:39 user nova-compute[70659]:   </features>
Jul 25 17:04:39 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:04:39 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:04:39 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:04:39 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:04:39 user nova-compute[70659]:   </clock>
Jul 25 17:04:39 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:04:39 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:04:39 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:04:39 user nova-compute[70659]:   </cpu>
Jul 25 17:04:39 user nova-compute[70659]:   <devices>
Jul 25 17:04:39 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:04:39 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:04:39 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk"/>
Jul 25 17:04:39 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:04:39 user nova-compute[70659]:     </disk>
Jul 25 17:04:39 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:04:39 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:04:39 user nova-compute[70659]:       <source dev="/dev/sdf"/>
Jul 25 17:04:39 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 17:04:39 user nova-compute[70659]:       <serial>7b1bd297-453d-4dd7-bb82-b4ba3624a9b4</serial>
Jul 25 17:04:39 user nova-compute[70659]:     </disk>
Jul 25 17:04:39 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:04:39 user nova-compute[70659]:       <mac address="fa:16:3e:66:54:bd"/>
Jul 25 17:04:39 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:04:39 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:04:39 user nova-compute[70659]:       <target dev="tapebdedf5d-69"/>
Jul 25 17:04:39 user nova-compute[70659]:     </interface>
Jul 25 17:04:39 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:04:39 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/console.log" append="off"/>
Jul 25 17:04:39 user nova-compute[70659]:     </serial>
Jul 25 17:04:39 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:04:39 user nova-compute[70659]:     <video>
Jul 25 17:04:39 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:04:39 user nova-compute[70659]:     </video>
Jul 25 17:04:39 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:04:39 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:04:39 user nova-compute[70659]:     </rng>
Jul 25 17:04:39 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:04:39 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:04:39 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:04:39 user nova-compute[70659]:     </memballoon>
Jul 25 17:04:39 user nova-compute[70659]:   </devices>
Jul 25 17:04:39 user nova-compute[70659]: </domain>
Jul 25 17:04:39 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.objects.instance [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'trusted_certs' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:04:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Cannot resize image /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG nova.objects.instance [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'migration_context' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1276348519',display_name='tempest-TestMinimumBasicScenario-server-1276348519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1276348519',id=34,image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP7iY75WewGd9w81yWLG0+aApzmPP1DdnbLIGJQjie10aI09rJyALWMwmNsSC+MotNHXs0rY3nOs6ehU+vvWvLRQsTX4H6VMaF2oCf/W+ixdSGtoMeVNIXKH6grRAXuEg==',key_name='tempest-TestMinimumBasicScenario-342159585',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='775d6e7c342a492f815f2c68c62b291a',ramdisk_id='',reservation_id='r-kqj3kgb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-866741703',owner_user_name='tempest-TestMinimumBasicScenario-866741703-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:04:37Z,user_data=None,user_id='b14f37927ee848b890ec02b3068251f3',uuid=a0f3fc7c-0f44-450b-a4c3-f628aad189ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converting VIF {"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG os_vif [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebdedf5d-69, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebdedf5d-69, col_values=(('external_ids', {'iface-id': 'ebdedf5d-69f8-4141-a81c-301b7347b9c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:54:bd', 'vm-uuid': 'a0f3fc7c-0f44-450b-a4c3-f628aad189ae'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:04:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:40 user nova-compute[70659]: INFO os_vif [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69')
Jul 25 17:04:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-5325cb45-612e-4726-bc85-8d37c38aba9d req-f3519c38-0cef-463c-a618-1644d7e3711e service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5325cb45-612e-4726-bc85-8d37c38aba9d req-f3519c38-0cef-463c-a618-1644d7e3711e service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5325cb45-612e-4726-bc85-8d37c38aba9d req-f3519c38-0cef-463c-a618-1644d7e3711e service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5325cb45-612e-4726-bc85-8d37c38aba9d req-f3519c38-0cef-463c-a618-1644d7e3711e service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-5325cb45-612e-4726-bc85-8d37c38aba9d req-f3519c38-0cef-463c-a618-1644d7e3711e service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:41 user nova-compute[70659]: WARNING nova.compute.manager [req-5325cb45-612e-4726-bc85-8d37c38aba9d req-f3519c38-0cef-463c-a618-1644d7e3711e service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received unexpected event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with vm_state active and task_state reboot_started_hard.
Jul 25 17:04:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for a0f3fc7c-0f44-450b-a4c3-f628aad189ae due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 17:04:43 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304683.9595902, a0f3fc7c-0f44-450b-a4c3-f628aad189ae => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:04:43 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] VM Resumed (Lifecycle Event)
Jul 25 17:04:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:04:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Instance rebooted successfully.
Jul 25 17:04:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:04:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:04:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:04:44 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 25 17:04:44 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304683.9613895, a0f3fc7c-0f44-450b-a4c3-f628aad189ae => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:04:44 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] VM Started (Lifecycle Event)
Jul 25 17:04:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:04:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-8ca70126-d766-438e-9947-78d66882abd2 req-42180a3a-f768-446e-bdbf-95a958b1a30b service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8ca70126-d766-438e-9947-78d66882abd2 req-42180a3a-f768-446e-bdbf-95a958b1a30b service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8ca70126-d766-438e-9947-78d66882abd2 req-42180a3a-f768-446e-bdbf-95a958b1a30b service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8ca70126-d766-438e-9947-78d66882abd2 req-42180a3a-f768-446e-bdbf-95a958b1a30b service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-8ca70126-d766-438e-9947-78d66882abd2 req-42180a3a-f768-446e-bdbf-95a958b1a30b service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:44 user nova-compute[70659]: WARNING nova.compute.manager [req-8ca70126-d766-438e-9947-78d66882abd2 req-42180a3a-f768-446e-bdbf-95a958b1a30b service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received unexpected event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with vm_state active and task_state reboot_started_hard.
Jul 25 17:04:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6f335c35-f970-4e79-967d-2c90edff6d21 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.977s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:45 user nova-compute[70659]: INFO nova.compute.manager [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Terminating instance
Jul 25 17:04:45 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-f189747a-a4be-4705-9b4c-a67ca7586b4e req-cd42915f-fa98-439d-a9fe-2479f606a935 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received event network-vif-unplugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f189747a-a4be-4705-9b4c-a67ca7586b4e req-cd42915f-fa98-439d-a9fe-2479f606a935 service nova] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f189747a-a4be-4705-9b4c-a67ca7586b4e req-cd42915f-fa98-439d-a9fe-2479f606a935 service nova] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f189747a-a4be-4705-9b4c-a67ca7586b4e req-cd42915f-fa98-439d-a9fe-2479f606a935 service nova] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-f189747a-a4be-4705-9b4c-a67ca7586b4e req-cd42915f-fa98-439d-a9fe-2479f606a935 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] No waiting events found dispatching network-vif-unplugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-f189747a-a4be-4705-9b4c-a67ca7586b4e req-cd42915f-fa98-439d-a9fe-2479f606a935 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received event network-vif-unplugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Instance destroyed successfully.
Jul 25 17:04:46 user nova-compute[70659]: DEBUG nova.objects.instance [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lazy-loading 'resources' on Instance uuid 6bad1ca0-56cf-4a8d-b86c-adb41383e656 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:01:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1156147027',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1156147027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1156147',id=33,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/dwcQId82y6EOytzqb7leDM+gjPq1jKwdf34bv7rbxXsvKS+wfDxA61BnCELnAEjbBzGL6MEORSUMqamTGtdRO7ArwZgmIRjCFKHCjJbWrW81rNaS0A1yeXyFRwC8DFg==',key_name='tempest-keypair-711783819',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:01:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fa5a2d8f3a548c7b7a2bd1747b253c3',ramdisk_id='',reservation_id='r-monww7gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1359034296',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1132e5daf391490f9440756cf9b2c9ca',uuid=6bad1ca0-56cf-4a8d-b86c-adb41383e656,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Converting VIF {"id": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "address": "fa:16:3e:dc:64:14", "network": {"id": "0a5db3a9-b6e0-4750-9d90-12fba2fa119d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-511542495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa5a2d8f3a548c7b7a2bd1747b253c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f11e4b-88", "ovs_interfaceid": "c3f11e4b-8894-4a84-a443-7f77a930fcc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:64:14,bridge_name='br-int',has_traffic_filtering=True,id=c3f11e4b-8894-4a84-a443-7f77a930fcc6,network=Network(0a5db3a9-b6e0-4750-9d90-12fba2fa119d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f11e4b-88') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG os_vif [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:64:14,bridge_name='br-int',has_traffic_filtering=True,id=c3f11e4b-8894-4a84-a443-7f77a930fcc6,network=Network(0a5db3a9-b6e0-4750-9d90-12fba2fa119d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f11e4b-88') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3f11e4b-88, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:04:46 user nova-compute[70659]: INFO os_vif [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:64:14,bridge_name='br-int',has_traffic_filtering=True,id=c3f11e4b-8894-4a84-a443-7f77a930fcc6,network=Network(0a5db3a9-b6e0-4750-9d90-12fba2fa119d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f11e4b-88')
Jul 25 17:04:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Deleting instance files /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656_del
Jul 25 17:04:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Deletion of /opt/stack/data/nova/instances/6bad1ca0-56cf-4a8d-b86c-adb41383e656_del complete
Jul 25 17:04:46 user nova-compute[70659]: INFO nova.compute.manager [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 25 17:04:46 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:04:46 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:47 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Took 1.04 seconds to deallocate network for instance.
Jul 25 17:04:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:47 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Deleted allocations for instance 6bad1ca0-56cf-4a8d-b86c-adb41383e656
Jul 25 17:04:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-f422714f-7d6e-4920-a3cb-b1c464f64045 req-0e2a33c3-105e-4a83-8d4a-f549e9ab7491 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received event network-vif-plugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f422714f-7d6e-4920-a3cb-b1c464f64045 req-0e2a33c3-105e-4a83-8d4a-f549e9ab7491 service nova] Acquiring lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f422714f-7d6e-4920-a3cb-b1c464f64045 req-0e2a33c3-105e-4a83-8d4a-f549e9ab7491 service nova] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f422714f-7d6e-4920-a3cb-b1c464f64045 req-0e2a33c3-105e-4a83-8d4a-f549e9ab7491 service nova] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-f422714f-7d6e-4920-a3cb-b1c464f64045 req-0e2a33c3-105e-4a83-8d4a-f549e9ab7491 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] No waiting events found dispatching network-vif-plugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:04:47 user nova-compute[70659]: WARNING nova.compute.manager [req-f422714f-7d6e-4920-a3cb-b1c464f64045 req-0e2a33c3-105e-4a83-8d4a-f549e9ab7491 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received unexpected event network-vif-plugged-c3f11e4b-8894-4a84-a443-7f77a930fcc6 for instance with vm_state deleted and task_state None.
Jul 25 17:04:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-f422714f-7d6e-4920-a3cb-b1c464f64045 req-0e2a33c3-105e-4a83-8d4a-f549e9ab7491 service nova] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Received event network-vif-deleted-c3f11e4b-8894-4a84-a443-7f77a930fcc6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:04:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04c127bb-274a-402d-a73a-b3e74346a4a1 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296 tempest-TestServerVolumeAttachScenarioOldVersion-1359034296-project-member] Lock "6bad1ca0-56cf-4a8d-b86c-adb41383e656" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.802s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:04:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:04:54 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:04:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:04:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:04:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:04:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:04:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304686.0979865, 6bad1ca0-56cf-4a8d-b86c-adb41383e656 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:05:01 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] VM Stopped (Lifecycle Event)
Jul 25 17:05:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ede5ee83-609e-4ef2-bef4-0404b558ea9a None None] [instance: 6bad1ca0-56cf-4a8d-b86c-adb41383e656] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:05:02 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:05:02 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:05:02 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7785MB free_disk=25.01455307006836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:05:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e006724d-e45a-405f-9084-544925aaa8ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 77750821-16ee-4945-88ff-a8445edab24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 856974f4-fd81-4d22-a316-5e08c36e35d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 8ea8589f-2203-4057-bf80-92e3f193936e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:05:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-4ac87deb-a008-4760-97eb-96aa61554aea req-1edd1b65-8771-4b0d-bcd9-7da1ff87c860 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received event network-changed-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-4ac87deb-a008-4760-97eb-96aa61554aea req-1edd1b65-8771-4b0d-bcd9-7da1ff87c860 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Refreshing instance network info cache due to event network-changed-dfc4dc98-da59-4eda-852a-2205abc67304. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4ac87deb-a008-4760-97eb-96aa61554aea req-1edd1b65-8771-4b0d-bcd9-7da1ff87c860 service nova] Acquiring lock "refresh_cache-8ea8589f-2203-4057-bf80-92e3f193936e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4ac87deb-a008-4760-97eb-96aa61554aea req-1edd1b65-8771-4b0d-bcd9-7da1ff87c860 service nova] Acquired lock "refresh_cache-8ea8589f-2203-4057-bf80-92e3f193936e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG nova.network.neutron [req-4ac87deb-a008-4760-97eb-96aa61554aea req-1edd1b65-8771-4b0d-bcd9-7da1ff87c860 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Refreshing network info cache for port dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "8ea8589f-2203-4057-bf80-92e3f193936e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "8ea8589f-2203-4057-bf80-92e3f193936e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:05:05 user nova-compute[70659]: INFO nova.compute.manager [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Terminating instance
Jul 25 17:05:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG nova.network.neutron [req-4ac87deb-a008-4760-97eb-96aa61554aea req-1edd1b65-8771-4b0d-bcd9-7da1ff87c860 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Updated VIF entry in instance network info cache for port dfc4dc98-da59-4eda-852a-2205abc67304. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG nova.network.neutron [req-4ac87deb-a008-4760-97eb-96aa61554aea req-1edd1b65-8771-4b0d-bcd9-7da1ff87c860 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Updating instance_info_cache with network_info: [{"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4ac87deb-a008-4760-97eb-96aa61554aea req-1edd1b65-8771-4b0d-bcd9-7da1ff87c860 service nova] Releasing lock "refresh_cache-8ea8589f-2203-4057-bf80-92e3f193936e" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-1c5a6c6a-242b-4737-b7e8-66b41634c55e req-809b06a8-0b25-43a5-a3a8-1f47d978a4e7 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received event network-vif-unplugged-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1c5a6c6a-242b-4737-b7e8-66b41634c55e req-809b06a8-0b25-43a5-a3a8-1f47d978a4e7 service nova] Acquiring lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1c5a6c6a-242b-4737-b7e8-66b41634c55e req-809b06a8-0b25-43a5-a3a8-1f47d978a4e7 service nova] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1c5a6c6a-242b-4737-b7e8-66b41634c55e req-809b06a8-0b25-43a5-a3a8-1f47d978a4e7 service nova] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-1c5a6c6a-242b-4737-b7e8-66b41634c55e req-809b06a8-0b25-43a5-a3a8-1f47d978a4e7 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] No waiting events found dispatching network-vif-unplugged-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-1c5a6c6a-242b-4737-b7e8-66b41634c55e req-809b06a8-0b25-43a5-a3a8-1f47d978a4e7 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received event network-vif-unplugged-dfc4dc98-da59-4eda-852a-2205abc67304 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:05:06 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Instance destroyed successfully.
Jul 25 17:05:06 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'resources' on Instance uuid 8ea8589f-2203-4057-bf80-92e3f193936e {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-901078322',display_name='tempest-AttachVolumeNegativeTest-server-901078322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-901078322',id=36,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo+rreI7O0H7kEv7TSBQTV6dmlGRKWXlnq6LlvxXHYKFMS/xBxM6Zx8TFO970MHzulEEQxEsg9OKUMiNOmq3NsLtoNCxGuXvs96sxBZSlKrEk14cwue7uIpJuBMMWsMTg==',key_name='tempest-keypair-726800176',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:03:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-d50n10da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:03:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=8ea8589f-2203-4057-bf80-92e3f193936e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "dfc4dc98-da59-4eda-852a-2205abc67304", "address": "fa:16:3e:89:5e:d3", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc4dc98-da", "ovs_interfaceid": "dfc4dc98-da59-4eda-852a-2205abc67304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:5e:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfc4dc98-da59-4eda-852a-2205abc67304,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc4dc98-da') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG os_vif [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5e:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfc4dc98-da59-4eda-852a-2205abc67304,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc4dc98-da') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfc4dc98-da, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:06 user nova-compute[70659]: INFO os_vif [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5e:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfc4dc98-da59-4eda-852a-2205abc67304,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc4dc98-da')
Jul 25 17:05:06 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Deleting instance files /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e_del
Jul 25 17:05:06 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Deletion of /opt/stack/data/nova/instances/8ea8589f-2203-4057-bf80-92e3f193936e_del complete
Jul 25 17:05:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:05:06 user nova-compute[70659]: INFO nova.compute.manager [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 25 17:05:06 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:05:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating instance_info_cache with network_info: [{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:05:07 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Took 1.23 seconds to deallocate network for instance.
Jul 25 17:05:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-d0a343a1-7d9a-41db-83d3-9c5d4fe095e8 req-29756341-24cd-4960-a8cb-10b61372064b service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received event network-vif-deleted-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-7a8de127-ce58-4d5c-b20b-718b7e6cd3dc req-50b2e38a-3a83-4a56-91b8-9288764fdc67 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received event network-vif-plugged-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7a8de127-ce58-4d5c-b20b-718b7e6cd3dc req-50b2e38a-3a83-4a56-91b8-9288764fdc67 service nova] Acquiring lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7a8de127-ce58-4d5c-b20b-718b7e6cd3dc req-50b2e38a-3a83-4a56-91b8-9288764fdc67 service nova] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7a8de127-ce58-4d5c-b20b-718b7e6cd3dc req-50b2e38a-3a83-4a56-91b8-9288764fdc67 service nova] Lock "8ea8589f-2203-4057-bf80-92e3f193936e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG nova.compute.manager [req-7a8de127-ce58-4d5c-b20b-718b7e6cd3dc req-50b2e38a-3a83-4a56-91b8-9288764fdc67 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] No waiting events found dispatching network-vif-plugged-dfc4dc98-da59-4eda-852a-2205abc67304 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:05:07 user nova-compute[70659]: WARNING nova.compute.manager [req-7a8de127-ce58-4d5c-b20b-718b7e6cd3dc req-50b2e38a-3a83-4a56-91b8-9288764fdc67 service nova] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Received unexpected event network-vif-plugged-dfc4dc98-da59-4eda-852a-2205abc67304 for instance with vm_state deleted and task_state None.
Jul 25 17:05:07 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:05:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:05:07 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Deleted allocations for instance 8ea8589f-2203-4057-bf80-92e3f193936e
Jul 25 17:05:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a64c3146-add5-4287-9094-98265b7cfa31 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "8ea8589f-2203-4057-bf80-92e3f193936e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.572s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:05:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:21 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304706.2455506, 8ea8589f-2203-4057-bf80-92e3f193936e => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:05:21 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] VM Stopped (Lifecycle Event)
Jul 25 17:05:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-33009998-3018-46b2-bdfc-55b6482ed558 None None] [instance: 8ea8589f-2203-4057-bf80-92e3f193936e] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:05:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:05:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:05:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:05:35 user nova-compute[70659]: INFO nova.compute.manager [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Detaching volume 24aafa45-075f-4cfc-9388-7e0b2478b3d7
Jul 25 17:05:35 user nova-compute[70659]: INFO nova.virt.block_device [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Attempting to driver detach volume 24aafa45-075f-4cfc-9388-7e0b2478b3d7 from mountpoint /dev/vdb
Jul 25 17:05:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Attempting to detach device vdb from instance 612d6677-e182-4337-a33e-622efb364df2 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:05:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:05:35 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:05:35 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 17:05:35 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:05:35 user nova-compute[70659]:   <serial>24aafa45-075f-4cfc-9388-7e0b2478b3d7</serial>
Jul 25 17:05:35 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 17:05:35 user nova-compute[70659]: </disk>
Jul 25 17:05:35 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:05:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully detached device vdb from instance 612d6677-e182-4337-a33e-622efb364df2 from the persistent domain config.
Jul 25 17:05:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 612d6677-e182-4337-a33e-622efb364df2 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:05:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:05:35 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:05:35 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 17:05:35 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:05:35 user nova-compute[70659]:   <serial>24aafa45-075f-4cfc-9388-7e0b2478b3d7</serial>
Jul 25 17:05:35 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 17:05:35 user nova-compute[70659]: </disk>
Jul 25 17:05:35 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304736.1931965, 612d6677-e182-4337-a33e-622efb364df2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:05:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully detached device vdb from instance 612d6677-e182-4337-a33e-622efb364df2 from the live domain config.
Jul 25 17:05:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qOQlfaLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:05:36 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7405ffd2-0c5a-4d8e-9ea3-f905fb7c00a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8253635-102b-42be-bd2c-4939ce9d13c4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:05:36 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:05:36 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:05:36 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:05:36 user nova-compute[70659]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:05:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:05:36 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:05:36 user nova-compute[70659]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 (non-flash)
Jul 25 17:05:36 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:05:36 user nova-compute[70659]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:05:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd36d7e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7'): ({'sdd'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Removing single pathed devices sdd {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a25ecc-8bbf-41e1-8c6c-0934140399c6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[19215fa7-d9f1-4949-9e2d-02456b289cc1]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flushing IO for device /dev/sdd {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1ea47d-64b9-4e73-ac1e-b2e1e6d2d8b4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6f46c6-d093-4e3d-8915-678f4e4bc1f6]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6b2c98-f6bf-482e-86c0-ec39c2130bd0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fafd66-be0d-49fa-856e-1f60a3d52346]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260]
Jul 25 17:05:36 user nova-compute[70659]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7, portal: 172.16.0.220,3260] successful.
Jul 25 17:05:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24aafa45-075f-4cfc-9388-7e0b2478b3d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e71a421-4aec-4670-81b1-c4b80391974b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== disconnect_volume: return (309ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:05:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:05:37 user nova-compute[70659]: DEBUG nova.objects.instance [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'flavor' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:05:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cc5c5515-510b-4bf3-a9e2-4fd53dc40912 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.751s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:05:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:55 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:56 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:05:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:05:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:05:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:05:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:05:57 user nova-compute[70659]: INFO nova.compute.manager [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Detaching volume 16cbb85e-6903-4c84-8d47-85b217f8b05a
Jul 25 17:05:57 user nova-compute[70659]: INFO nova.virt.block_device [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Attempting to driver detach volume 16cbb85e-6903-4c84-8d47-85b217f8b05a from mountpoint /dev/vdb
Jul 25 17:05:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Attempting to detach device vdb from instance 77750821-16ee-4945-88ff-a8445edab24b from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:05:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:05:57 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:05:57 user nova-compute[70659]:   <source dev="/dev/sde"/>
Jul 25 17:05:57 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:05:57 user nova-compute[70659]:   <serial>16cbb85e-6903-4c84-8d47-85b217f8b05a</serial>
Jul 25 17:05:57 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:05:57 user nova-compute[70659]: </disk>
Jul 25 17:05:57 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:05:57 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully detached device vdb from instance 77750821-16ee-4945-88ff-a8445edab24b from the persistent domain config.
Jul 25 17:05:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77750821-16ee-4945-88ff-a8445edab24b from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:05:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:05:57 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:05:57 user nova-compute[70659]:   <source dev="/dev/sde"/>
Jul 25 17:05:57 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:05:57 user nova-compute[70659]:   <serial>16cbb85e-6903-4c84-8d47-85b217f8b05a</serial>
Jul 25 17:05:57 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:05:57 user nova-compute[70659]: </disk>
Jul 25 17:05:57 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304758.242276, 77750821-16ee-4945-88ff-a8445edab24b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77750821-16ee-4945-88ff-a8445edab24b {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:05:58 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully detached device vdb from instance 77750821-16ee-4945-88ff-a8445edab24b from the live domain config.
Jul 25 17:05:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvplyGJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:05:58 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[732212fa-00c1-41d0-8e96-1777c0343e01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[410e99ad-a7ac-4a44-ac65-f8548ccc3ce4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:05:58 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:05:58 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:05:58 user nova-compute[70659]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:05:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:05:58 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:05:58 user nova-compute[70659]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a (non-flash)
Jul 25 17:05:58 user nova-compute[70659]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:05:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd3153bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a'): ({'sde'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Removing single pathed devices sde {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0847ebe-748f-4424-a532-52e6a429a5c6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1cdf32-7780-4cd1-986f-41d2b2a42c2d]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flushing IO for device /dev/sde {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b987a3b1-9f31-424c-a5fd-ee5c99c770ea]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c53e5f7-9774-4a4f-82b7-fd91c3bed2ed]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[195eaabf-1cd3-48b1-85ab-c84f1e0e7d15]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91846ff-38c3-45b8-8f43-e5e10ca95f27]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a, portal: 172.16.0.220,3260]
Jul 25 17:05:58 user nova-compute[70659]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a, portal: 172.16.0.220,3260] successful.
Jul 25 17:05:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16cbb85e-6903-4c84-8d47-85b217f8b05a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b26e86-76eb-43d1-a93a-545c5c4c848a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] <== disconnect_volume: return (280ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:05:58 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:05:59 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'flavor' on Instance uuid 77750821-16ee-4945-88ff-a8445edab24b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:05:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ddfd93cc-07a4-4557-b867-fedc692385fb tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:05:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:00 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:06:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:06:03 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:06:03 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:06:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8061MB free_disk=25.029102325439453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:06:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e006724d-e45a-405f-9084-544925aaa8ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 77750821-16ee-4945-88ff-a8445edab24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 856974f4-fd81-4d22-a316-5e08c36e35d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1724}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.291s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:06:04 user nova-compute[70659]: INFO nova.compute.claims [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Claim successful on node user
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.network.neutron [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:06:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:06:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:06:05 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Creating image(s)
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "/opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "/opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "/opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG nova.policy [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30a6a0a3df2e4e7fbf7a7c016b4dda9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff2a3c733c94c5992af0aabab215a22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk 1073741824" returned: 0 in 0.056s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Cannot resize image /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG nova.objects.instance [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lazy-loading 'migration_context' on Instance uuid 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Ensure instance console log exists: /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Successfully created port: 96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Successfully updated port: 96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "refresh_cache-5eb4c44f-9955-4203-a3e6-8352cd9045ee" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquired lock "refresh_cache-5eb4c44f-9955-4203-a3e6-8352cd9045ee" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-c4d22669-15af-41b9-906e-37ea205e0eee req-783f922c-18ba-4fa1-aadf-069066da7635 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received event network-changed-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-c4d22669-15af-41b9-906e-37ea205e0eee req-783f922c-18ba-4fa1-aadf-069066da7635 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Refreshing instance network info cache due to event network-changed-96efaf7d-6841-483f-8ba2-ded3327ac82f. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4d22669-15af-41b9-906e-37ea205e0eee req-783f922c-18ba-4fa1-aadf-069066da7635 service nova] Acquiring lock "refresh_cache-5eb4c44f-9955-4203-a3e6-8352cd9045ee" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-e006724d-e45a-405f-9084-544925aaa8ad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-e006724d-e45a-405f-9084-544925aaa8ad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:06:06 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.network.neutron [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Updating instance_info_cache with network_info: [{"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Releasing lock "refresh_cache-5eb4c44f-9955-4203-a3e6-8352cd9045ee" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Instance network_info: |[{"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4d22669-15af-41b9-906e-37ea205e0eee req-783f922c-18ba-4fa1-aadf-069066da7635 service nova] Acquired lock "refresh_cache-5eb4c44f-9955-4203-a3e6-8352cd9045ee" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.network.neutron [req-c4d22669-15af-41b9-906e-37ea205e0eee req-783f922c-18ba-4fa1-aadf-069066da7635 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Refreshing network info cache for port 96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Start _get_guest_xml network_info=[{"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:06:07 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:06:07 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-115601352',display_name='tempest-TestServerVolumeAttachmentScenario-server-115601352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-115601352',id=37,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpMVZDTLQd9LFhWIVcUj8kwYcCqR8kSGADQO5iIWATEo5y4KEfRWx+5MMK3K3Ynnp4N5JnXndzif3p/adl+rV2CllN7JNsLNvMLHnK2ofIKbPBkYROozt6HPw5Zg3etaw==',key_name='tempest-keypair-1044882777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff2a3c733c94c5992af0aabab215a22',ramdisk_id='',reservation_id='r-oxkmkz67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-743665487',owner_user_name='tempest-TestServerVolumeAttachmentScenario-743665487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30a6a0a3df2e4e7fbf7a7c016b4dda9f',uuid=5eb4c44f-9955-4203-a3e6-8352cd9045ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Converting VIF {"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=96efaf7d-6841-483f-8ba2-ded3327ac82f,network=Network(4bec5172-9cb2-418a-8a65-c295dc90c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96efaf7d-68') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.objects.instance [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lazy-loading 'pci_devices' on Instance uuid 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:06:07 user nova-compute[70659]:   <uuid>5eb4c44f-9955-4203-a3e6-8352cd9045ee</uuid>
Jul 25 17:06:07 user nova-compute[70659]:   <name>instance-00000025</name>
Jul 25 17:06:07 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:06:07 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:06:07 user nova-compute[70659]:   <metadata>
Jul 25 17:06:07 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:06:07 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:06:07 user nova-compute[70659]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-115601352</nova:name>
Jul 25 17:06:07 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:06:07</nova:creationTime>
Jul 25 17:06:07 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:06:07 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:06:07 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:06:07 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:06:07 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:06:07 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:06:07 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:06:07 user nova-compute[70659]:       <nova:owner>
Jul 25 17:06:07 user nova-compute[70659]:         <nova:user uuid="30a6a0a3df2e4e7fbf7a7c016b4dda9f">tempest-TestServerVolumeAttachmentScenario-743665487-project-member</nova:user>
Jul 25 17:06:07 user nova-compute[70659]:         <nova:project uuid="aff2a3c733c94c5992af0aabab215a22">tempest-TestServerVolumeAttachmentScenario-743665487</nova:project>
Jul 25 17:06:07 user nova-compute[70659]:       </nova:owner>
Jul 25 17:06:07 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:06:07 user nova-compute[70659]:       <nova:ports>
Jul 25 17:06:07 user nova-compute[70659]:         <nova:port uuid="96efaf7d-6841-483f-8ba2-ded3327ac82f">
Jul 25 17:06:07 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 17:06:07 user nova-compute[70659]:         </nova:port>
Jul 25 17:06:07 user nova-compute[70659]:       </nova:ports>
Jul 25 17:06:07 user nova-compute[70659]:     </nova:instance>
Jul 25 17:06:07 user nova-compute[70659]:   </metadata>
Jul 25 17:06:07 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:06:07 user nova-compute[70659]:     <system>
Jul 25 17:06:07 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:06:07 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:06:07 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:06:07 user nova-compute[70659]:       <entry name="serial">5eb4c44f-9955-4203-a3e6-8352cd9045ee</entry>
Jul 25 17:06:07 user nova-compute[70659]:       <entry name="uuid">5eb4c44f-9955-4203-a3e6-8352cd9045ee</entry>
Jul 25 17:06:07 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:06:07 user nova-compute[70659]:     </system>
Jul 25 17:06:07 user nova-compute[70659]:   </sysinfo>
Jul 25 17:06:07 user nova-compute[70659]:   <os>
Jul 25 17:06:07 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:06:07 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:06:07 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:06:07 user nova-compute[70659]:   </os>
Jul 25 17:06:07 user nova-compute[70659]:   <features>
Jul 25 17:06:07 user nova-compute[70659]:     <acpi/>
Jul 25 17:06:07 user nova-compute[70659]:     <apic/>
Jul 25 17:06:07 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:06:07 user nova-compute[70659]:   </features>
Jul 25 17:06:07 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:06:07 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:06:07 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:06:07 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:06:07 user nova-compute[70659]:   </clock>
Jul 25 17:06:07 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:06:07 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:06:07 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:06:07 user nova-compute[70659]:   </cpu>
Jul 25 17:06:07 user nova-compute[70659]:   <devices>
Jul 25 17:06:07 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:06:07 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:06:07 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk"/>
Jul 25 17:06:07 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:06:07 user nova-compute[70659]:     </disk>
Jul 25 17:06:07 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:06:07 user nova-compute[70659]:       <mac address="fa:16:3e:8b:30:1a"/>
Jul 25 17:06:07 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:06:07 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:06:07 user nova-compute[70659]:       <target dev="tap96efaf7d-68"/>
Jul 25 17:06:07 user nova-compute[70659]:     </interface>
Jul 25 17:06:07 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:06:07 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/console.log" append="off"/>
Jul 25 17:06:07 user nova-compute[70659]:     </serial>
Jul 25 17:06:07 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:06:07 user nova-compute[70659]:     <video>
Jul 25 17:06:07 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:06:07 user nova-compute[70659]:     </video>
Jul 25 17:06:07 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:06:07 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:06:07 user nova-compute[70659]:     </rng>
Jul 25 17:06:07 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:06:07 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:06:07 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:06:07 user nova-compute[70659]:     </memballoon>
Jul 25 17:06:07 user nova-compute[70659]:   </devices>
Jul 25 17:06:07 user nova-compute[70659]: </domain>
Jul 25 17:06:07 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-115601352',display_name='tempest-TestServerVolumeAttachmentScenario-server-115601352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-115601352',id=37,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpMVZDTLQd9LFhWIVcUj8kwYcCqR8kSGADQO5iIWATEo5y4KEfRWx+5MMK3K3Ynnp4N5JnXndzif3p/adl+rV2CllN7JNsLNvMLHnK2ofIKbPBkYROozt6HPw5Zg3etaw==',key_name='tempest-keypair-1044882777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aff2a3c733c94c5992af0aabab215a22',ramdisk_id='',reservation_id='r-oxkmkz67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-743665487',owner_user_name='tempest-TestServerVolumeAttachmentScenario-743665487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30a6a0a3df2e4e7fbf7a7c016b4dda9f',uuid=5eb4c44f-9955-4203-a3e6-8352cd9045ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Converting VIF {"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=96efaf7d-6841-483f-8ba2-ded3327ac82f,network=Network(4bec5172-9cb2-418a-8a65-c295dc90c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96efaf7d-68') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG os_vif [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=96efaf7d-6841-483f-8ba2-ded3327ac82f,network=Network(4bec5172-9cb2-418a-8a65-c295dc90c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96efaf7d-68') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96efaf7d-68, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96efaf7d-68, col_values=(('external_ids', {'iface-id': '96efaf7d-6841-483f-8ba2-ded3327ac82f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:30:1a', 'vm-uuid': '5eb4c44f-9955-4203-a3e6-8352cd9045ee'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:07 user nova-compute[70659]: INFO os_vif [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=96efaf7d-6841-483f-8ba2-ded3327ac82f,network=Network(4bec5172-9cb2-418a-8a65-c295dc90c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96efaf7d-68')
Jul 25 17:06:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] No VIF found with MAC fa:16:3e:8b:30:1a, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.network.neutron [req-c4d22669-15af-41b9-906e-37ea205e0eee req-783f922c-18ba-4fa1-aadf-069066da7635 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Updated VIF entry in instance network info cache for port 96efaf7d-6841-483f-8ba2-ded3327ac82f. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.network.neutron [req-c4d22669-15af-41b9-906e-37ea205e0eee req-783f922c-18ba-4fa1-aadf-069066da7635 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Updating instance_info_cache with network_info: [{"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4d22669-15af-41b9-906e-37ea205e0eee req-783f922c-18ba-4fa1-aadf-069066da7635 service nova] Releasing lock "refresh_cache-5eb4c44f-9955-4203-a3e6-8352cd9045ee" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Updating instance_info_cache with network_info: [{"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-e006724d-e45a-405f-9084-544925aaa8ad" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:07 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-5fdd9912-733c-4781-b01e-be45d77ef47b req-8b050b38-f771-4e8c-80e9-b6586bbd5a37 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received event network-vif-plugged-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5fdd9912-733c-4781-b01e-be45d77ef47b req-8b050b38-f771-4e8c-80e9-b6586bbd5a37 service nova] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5fdd9912-733c-4781-b01e-be45d77ef47b req-8b050b38-f771-4e8c-80e9-b6586bbd5a37 service nova] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5fdd9912-733c-4781-b01e-be45d77ef47b req-8b050b38-f771-4e8c-80e9-b6586bbd5a37 service nova] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-5fdd9912-733c-4781-b01e-be45d77ef47b req-8b050b38-f771-4e8c-80e9-b6586bbd5a37 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] No waiting events found dispatching network-vif-plugged-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:08 user nova-compute[70659]: WARNING nova.compute.manager [req-5fdd9912-733c-4781-b01e-be45d77ef47b req-8b050b38-f771-4e8c-80e9-b6586bbd5a37 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received unexpected event network-vif-plugged-96efaf7d-6841-483f-8ba2-ded3327ac82f for instance with vm_state building and task_state spawning.
Jul 25 17:06:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304770.7864096, 5eb4c44f-9955-4203-a3e6-8352cd9045ee => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:06:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] VM Resumed (Lifecycle Event)
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:06:10 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Instance spawned successfully.
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304770.788041, 5eb4c44f-9955-4203-a3e6-8352cd9045ee => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:06:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] VM Started (Lifecycle Event)
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:06:10 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:06:10 user nova-compute[70659]: INFO nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Took 5.81 seconds to spawn the instance on the hypervisor.
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-a03b7ca4-2a2a-4289-b96f-bab0b95a4c0d req-564604d2-0132-4975-a080-9be85bc6bfab service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received event network-vif-plugged-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a03b7ca4-2a2a-4289-b96f-bab0b95a4c0d req-564604d2-0132-4975-a080-9be85bc6bfab service nova] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a03b7ca4-2a2a-4289-b96f-bab0b95a4c0d req-564604d2-0132-4975-a080-9be85bc6bfab service nova] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a03b7ca4-2a2a-4289-b96f-bab0b95a4c0d req-564604d2-0132-4975-a080-9be85bc6bfab service nova] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-a03b7ca4-2a2a-4289-b96f-bab0b95a4c0d req-564604d2-0132-4975-a080-9be85bc6bfab service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] No waiting events found dispatching network-vif-plugged-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:10 user nova-compute[70659]: WARNING nova.compute.manager [req-a03b7ca4-2a2a-4289-b96f-bab0b95a4c0d req-564604d2-0132-4975-a080-9be85bc6bfab service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received unexpected event network-vif-plugged-96efaf7d-6841-483f-8ba2-ded3327ac82f for instance with vm_state building and task_state spawning.
Jul 25 17:06:10 user nova-compute[70659]: INFO nova.compute.manager [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Took 6.82 seconds to build instance.
Jul 25 17:06:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46302cc8-58e2-40d5-93b3-bc5bd390f3cb tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.919s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:19 user nova-compute[70659]: INFO nova.compute.manager [None req-1b3ab5c4-1c16-4d2f-bd80-f022c5a3cc3f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Unrescuing
Jul 25 17:06:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b3ab5c4-1c16-4d2f-bd80-f022c5a3cc3f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:06:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b3ab5c4-1c16-4d2f-bd80-f022c5a3cc3f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquired lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:06:19 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1b3ab5c4-1c16-4d2f-bd80-f022c5a3cc3f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1b3ab5c4-1c16-4d2f-bd80-f022c5a3cc3f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Updating instance_info_cache with network_info: [{"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b3ab5c4-1c16-4d2f-bd80-f022c5a3cc3f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Releasing lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1b3ab5c4-1c16-4d2f-bd80-f022c5a3cc3f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'flavor' on Instance uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-6cc62288-26ff-4a85-8b76-991f69989239 req-95a98898-fdc1-48ff-a4cf-998c2239804f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6cc62288-26ff-4a85-8b76-991f69989239 req-95a98898-fdc1-48ff-a4cf-998c2239804f service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6cc62288-26ff-4a85-8b76-991f69989239 req-95a98898-fdc1-48ff-a4cf-998c2239804f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6cc62288-26ff-4a85-8b76-991f69989239 req-95a98898-fdc1-48ff-a4cf-998c2239804f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-6cc62288-26ff-4a85-8b76-991f69989239 req-95a98898-fdc1-48ff-a4cf-998c2239804f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:20 user nova-compute[70659]: WARNING nova.compute.manager [req-6cc62288-26ff-4a85-8b76-991f69989239 req-95a98898-fdc1-48ff-a4cf-998c2239804f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:06:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:20 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Instance destroyed successfully.
Jul 25 17:06:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:22 user nova-compute[70659]: WARNING nova.compute.manager [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:06:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:22 user nova-compute[70659]: WARNING nova.compute.manager [req-09d483cd-e54b-4be1-87c9-7a0b2acc3d61 req-dffa8e12-a8e2-4a51-aee3-c1f5aedd2aac service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:06:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for 856974f4-fd81-4d22-a316-5e08c36e35d6 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304784.399586, 856974f4-fd81-4d22-a316-5e08c36e35d6 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:06:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] VM Resumed (Lifecycle Event)
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1b3ab5c4-1c16-4d2f-bd80-f022c5a3cc3f tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:06:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304784.4033926, 856974f4-fd81-4d22-a316-5e08c36e35d6 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:06:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] VM Started (Lifecycle Event)
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-7932cec1-55f7-4f15-bc61-80b45ddae2e1 req-3fdec007-4b8d-4f50-bdb2-34060419a6a7 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7932cec1-55f7-4f15-bc61-80b45ddae2e1 req-3fdec007-4b8d-4f50-bdb2-34060419a6a7 service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7932cec1-55f7-4f15-bc61-80b45ddae2e1 req-3fdec007-4b8d-4f50-bdb2-34060419a6a7 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7932cec1-55f7-4f15-bc61-80b45ddae2e1 req-3fdec007-4b8d-4f50-bdb2-34060419a6a7 service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-7932cec1-55f7-4f15-bc61-80b45ddae2e1 req-3fdec007-4b8d-4f50-bdb2-34060419a6a7 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:24 user nova-compute[70659]: WARNING nova.compute.manager [req-7932cec1-55f7-4f15-bc61-80b45ddae2e1 req-3fdec007-4b8d-4f50-bdb2-34060419a6a7 service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state active and task_state None.
Jul 25 17:06:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:24 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:06:24 user nova-compute[70659]: INFO nova.compute.claims [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Claim successful on node user
Jul 25 17:06:25 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:06:25 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:06:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG nova.policy [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c9f4887220e4691b50538353a898b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930ca993f8d04c03b073fbe183f064de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:06:25 user nova-compute[70659]: INFO nova.virt.block_device [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Booting with volume 033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 at /dev/vda
Jul 25 17:06:25 user nova-compute[70659]: DEBUG os_brick.utils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5976678f-ea76-4f09-b096-bd310e0d5a1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcdc119-3b54-44c3-b57d-4386546d775b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3026d8-cf87-48bd-9cfa-c4a7b96cb1c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd3f2c7-7772-4e18-8e59-b1bfd91af034]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:06:25 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:06:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab8f7a1-3080-46b6-a746-64b6c5b8b18d]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG os_brick.utils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:06:25 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating existing volume attachment record: e72a1bb2-36aa-4bf1-89f9-aa82288603fa {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:06:26 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Successfully created port: 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Successfully updated port: 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquired lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-94ea4317-64ee-41fb-9be4-31eed49ec5fc req-d7b9dd0e-bcd9-4345-9c8b-19b64b6cf9c1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-94ea4317-64ee-41fb-9be4-31eed49ec5fc req-d7b9dd0e-bcd9-4345-9c8b-19b64b6cf9c1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing instance network info cache due to event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-94ea4317-64ee-41fb-9be4-31eed49ec5fc req-d7b9dd0e-bcd9-4345-9c8b-19b64b6cf9c1 service nova] Acquiring lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG nova.network.neutron [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating instance_info_cache with network_info: [{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Releasing lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Instance network_info: |[{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-94ea4317-64ee-41fb-9be4-31eed49ec5fc req-d7b9dd0e-bcd9-4345-9c8b-19b64b6cf9c1 service nova] Acquired lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:06:27 user nova-compute[70659]: DEBUG nova.network.neutron [req-94ea4317-64ee-41fb-9be4-31eed49ec5fc req-d7b9dd0e-bcd9-4345-9c8b-19b64b6cf9c1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:06:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-94ea4317-64ee-41fb-9be4-31eed49ec5fc req-d7b9dd0e-bcd9-4345-9c8b-19b64b6cf9c1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updated VIF entry in instance network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:06:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-94ea4317-64ee-41fb-9be4-31eed49ec5fc req-d7b9dd0e-bcd9-4345-9c8b-19b64b6cf9c1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating instance_info_cache with network_info: [{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:06:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-94ea4317-64ee-41fb-9be4-31eed49ec5fc req-d7b9dd0e-bcd9-4345-9c8b-19b64b6cf9c1 service nova] Releasing lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:06:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-b6dc6bce-ab45-49de-a4d5-715ba956635b req-1a005d42-bb17-4b92-a222-b10f80b9539a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-b6dc6bce-ab45-49de-a4d5-715ba956635b req-1a005d42-bb17-4b92-a222-b10f80b9539a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing instance network info cache due to event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:06:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b6dc6bce-ab45-49de-a4d5-715ba956635b req-1a005d42-bb17-4b92-a222-b10f80b9539a service nova] Acquiring lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:06:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b6dc6bce-ab45-49de-a4d5-715ba956635b req-1a005d42-bb17-4b92-a222-b10f80b9539a service nova] Acquired lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:06:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-b6dc6bce-ab45-49de-a4d5-715ba956635b req-1a005d42-bb17-4b92-a222-b10f80b9539a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG nova.network.neutron [req-b6dc6bce-ab45-49de-a4d5-715ba956635b req-1a005d42-bb17-4b92-a222-b10f80b9539a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updated VIF entry in instance network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG nova.network.neutron [req-b6dc6bce-ab45-49de-a4d5-715ba956635b req-1a005d42-bb17-4b92-a222-b10f80b9539a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating instance_info_cache with network_info: [{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b6dc6bce-ab45-49de-a4d5-715ba956635b req-1a005d42-bb17-4b92-a222-b10f80b9539a service nova] Releasing lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-6f4aed9b-fa87-4f8a-a3b4-bc8ef7b7237c req-4817e46b-15ee-446d-a05e-7d25af0ccee7 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-6f4aed9b-fa87-4f8a-a3b4-bc8ef7b7237c req-4817e46b-15ee-446d-a05e-7d25af0ccee7 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing instance network info cache due to event network-changed-ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f4aed9b-fa87-4f8a-a3b4-bc8ef7b7237c req-4817e46b-15ee-446d-a05e-7d25af0ccee7 service nova] Acquiring lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f4aed9b-fa87-4f8a-a3b4-bc8ef7b7237c req-4817e46b-15ee-446d-a05e-7d25af0ccee7 service nova] Acquired lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG nova.network.neutron [req-6f4aed9b-fa87-4f8a-a3b4-bc8ef7b7237c req-4817e46b-15ee-446d-a05e-7d25af0ccee7 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Refreshing network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:30 user nova-compute[70659]: INFO nova.compute.manager [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Detaching volume 7b1bd297-453d-4dd7-bb82-b4ba3624a9b4
Jul 25 17:06:30 user nova-compute[70659]: INFO nova.virt.block_device [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Attempting to driver detach volume 7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 from mountpoint /dev/vdb
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Attempting to detach device vdb from instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:06:30 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:06:30 user nova-compute[70659]:   <source dev="/dev/sdf"/>
Jul 25 17:06:30 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:06:30 user nova-compute[70659]:   <serial>7b1bd297-453d-4dd7-bb82-b4ba3624a9b4</serial>
Jul 25 17:06:30 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 17:06:30 user nova-compute[70659]: </disk>
Jul 25 17:06:30 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:06:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully detached device vdb from instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae from the persistent domain config.
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:06:30 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:06:30 user nova-compute[70659]:   <source dev="/dev/sdf"/>
Jul 25 17:06:30 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:06:30 user nova-compute[70659]:   <serial>7b1bd297-453d-4dd7-bb82-b4ba3624a9b4</serial>
Jul 25 17:06:30 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 17:06:30 user nova-compute[70659]: </disk>
Jul 25 17:06:30 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.network.neutron [req-6f4aed9b-fa87-4f8a-a3b4-bc8ef7b7237c req-4817e46b-15ee-446d-a05e-7d25af0ccee7 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updated VIF entry in instance network info cache for port ebdedf5d-69f8-4141-a81c-301b7347b9c4. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.network.neutron [req-6f4aed9b-fa87-4f8a-a3b4-bc8ef7b7237c req-4817e46b-15ee-446d-a05e-7d25af0ccee7 service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating instance_info_cache with network_info: [{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6f4aed9b-fa87-4f8a-a3b4-bc8ef7b7237c req-4817e46b-15ee-446d-a05e-7d25af0ccee7 service nova] Releasing lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304790.6369808, a0f3fc7c-0f44-450b-a4c3-f628aad189ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:06:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully detached device vdb from instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae from the live domain config.
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgCjPSea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:06:30 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba0df78-5783-46ac-a922-a1d95e53c37b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d178dcb6-b9ae-4c46-b56f-4e66c61aaa66]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:06:30 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:06:30 user nova-compute[70659]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:06:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:06:30 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:06:30 user nova-compute[70659]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 (non-flash)
Jul 25 17:06:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd36da0430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4'): ({'sdf'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Removing single pathed devices sdf {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a6b4f1-06ce-4a32-bb3c-48815aaf00db]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dff713-6b7f-42f0-b094-d96448d0b28b]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Flushing IO for device /dev/sdf {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a733cdd9-5f4c-4169-84ba-617213c1f691]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d1423f-127e-44a1-825a-4c4ac2b5b7e8]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[81470224-6ae6-448d-abfe-400944ab255b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dafa87b-1913-470d-8a27-3f467472319e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260]
Jul 25 17:06:30 user nova-compute[70659]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4, portal: 172.16.0.220,3260] successful.
Jul 25 17:06:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1bd297-453d-4dd7-bb82-b4ba3624a9b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3b74d5-9cf9-4856-8393-1ca1321d9c9d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] <== disconnect_volume: return (322ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:06:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:06:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:06:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Creating image(s)
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Ensure instance console log exists: /opt/stack/data/nova/instances/8cf2697d-18c1-49bd-9f7f-08885d943672/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Start _get_guest_xml network_info=[{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e72a1bb2-36aa-4bf1-89f9-aa82288603fa', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhMcJqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8cf2697d-18c1-49bd-9f7f-08885d943672', 'attached_at': '', 'detached_at': '', 'volume_id': '033a1f84-c53f-4b09-8cbf-ef5d00ac01d5', 'serial': '033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:06:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:06:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhMcJqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:06:33 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:06:33 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:06:33 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31f1a0c-573e-4cdf-b3b9-1d7b79fbc39d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:06:33 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'flavor' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddf573b-c6f7-4cd6-9d49-0a873dfffdcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5] added
Jul 25 17:06:33 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b4714-060f-40aa-b90d-140e91965e18]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04b433ef-c761-48ee-8306-a6484feffa7b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.811s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5029d4-d30c-4500-b87a-915c763c5de7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhMcJqeY {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhMcJqeY" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf6453a-45a7-49c9-b8b9-6ed8480eea10]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VhMcJqeY'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aad120a-69d5-4353-b09a-77aa781fee10]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76c859b-355d-4e42-bc87-66fc8e9fb702]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:06:33 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:06:33 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:06:33 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:06:33 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb0b11e-254c-4eee-95dc-3aad0bfbd1f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260]
Jul 25 17:06:33 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260] successful.
Jul 25 17:06:33 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e74d16-de91-4581-8300-8d9d4f21a81b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[50053204-770f-4a6a-9660-7a2b194efa3c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:06:34 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:06:34 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:06:34 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:06:34 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:06:34 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:06:34 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f92e58-b01e-42f1-a8fd-40a70eef59e1]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:06:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhMcJqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23630343439336166', 'path': '/dev/sdd'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630343439336166', 'path': '/dev/sdd'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385776309',display_name='tempest-TestShelveInstance-server-1385776309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385776309',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfS7GX2feKTnfrOaK06MJipk+KIrTAhOCa2C2a/Ye7ImGNYQ+C55l3y85Amnav7T5TbVBED5Ch9B2LsPgo7UEH3fC9jrWXUwMvUgcG2wf3WoW0jsTnUS90XFRIDQUyTsg==',key_name='tempest-TestShelveInstance-1694808483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930ca993f8d04c03b073fbe183f064de',ramdisk_id='',reservation_id='r-tc9ckny8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-396312487',owner_user_name='tempest-TestShelveInstance-396312487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:06:25Z,user_data=None,user_id='7c9f4887220e4691b50538353a898b73',uuid=8cf2697d-18c1-49bd-9f7f-08885d943672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converting VIF {"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.objects.instance [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cf2697d-18c1-49bd-9f7f-08885d943672 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:06:35 user nova-compute[70659]:   <uuid>8cf2697d-18c1-49bd-9f7f-08885d943672</uuid>
Jul 25 17:06:35 user nova-compute[70659]:   <name>instance-00000026</name>
Jul 25 17:06:35 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:06:35 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:06:35 user nova-compute[70659]:   <metadata>
Jul 25 17:06:35 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:06:35 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:06:35 user nova-compute[70659]:       <nova:name>tempest-TestShelveInstance-server-1385776309</nova:name>
Jul 25 17:06:35 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:06:33</nova:creationTime>
Jul 25 17:06:35 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:06:35 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:06:35 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:06:35 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:06:35 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:06:35 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:06:35 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:06:35 user nova-compute[70659]:       <nova:owner>
Jul 25 17:06:35 user nova-compute[70659]:         <nova:user uuid="7c9f4887220e4691b50538353a898b73">tempest-TestShelveInstance-396312487-project-member</nova:user>
Jul 25 17:06:35 user nova-compute[70659]:         <nova:project uuid="930ca993f8d04c03b073fbe183f064de">tempest-TestShelveInstance-396312487</nova:project>
Jul 25 17:06:35 user nova-compute[70659]:       </nova:owner>
Jul 25 17:06:35 user nova-compute[70659]:       <nova:ports>
Jul 25 17:06:35 user nova-compute[70659]:         <nova:port uuid="3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a">
Jul 25 17:06:35 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 17:06:35 user nova-compute[70659]:         </nova:port>
Jul 25 17:06:35 user nova-compute[70659]:       </nova:ports>
Jul 25 17:06:35 user nova-compute[70659]:     </nova:instance>
Jul 25 17:06:35 user nova-compute[70659]:   </metadata>
Jul 25 17:06:35 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:06:35 user nova-compute[70659]:     <system>
Jul 25 17:06:35 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:06:35 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:06:35 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:06:35 user nova-compute[70659]:       <entry name="serial">8cf2697d-18c1-49bd-9f7f-08885d943672</entry>
Jul 25 17:06:35 user nova-compute[70659]:       <entry name="uuid">8cf2697d-18c1-49bd-9f7f-08885d943672</entry>
Jul 25 17:06:35 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:06:35 user nova-compute[70659]:     </system>
Jul 25 17:06:35 user nova-compute[70659]:   </sysinfo>
Jul 25 17:06:35 user nova-compute[70659]:   <os>
Jul 25 17:06:35 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:06:35 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:06:35 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:06:35 user nova-compute[70659]:   </os>
Jul 25 17:06:35 user nova-compute[70659]:   <features>
Jul 25 17:06:35 user nova-compute[70659]:     <acpi/>
Jul 25 17:06:35 user nova-compute[70659]:     <apic/>
Jul 25 17:06:35 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:06:35 user nova-compute[70659]:   </features>
Jul 25 17:06:35 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:06:35 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:06:35 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:06:35 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:06:35 user nova-compute[70659]:   </clock>
Jul 25 17:06:35 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:06:35 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:06:35 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:06:35 user nova-compute[70659]:   </cpu>
Jul 25 17:06:35 user nova-compute[70659]:   <devices>
Jul 25 17:06:35 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:06:35 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:06:35 user nova-compute[70659]:       <source dev="/dev/sdd"/>
Jul 25 17:06:35 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:06:35 user nova-compute[70659]:       <serial>033a1f84-c53f-4b09-8cbf-ef5d00ac01d5</serial>
Jul 25 17:06:35 user nova-compute[70659]:     </disk>
Jul 25 17:06:35 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:06:35 user nova-compute[70659]:       <mac address="fa:16:3e:22:31:55"/>
Jul 25 17:06:35 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:06:35 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:06:35 user nova-compute[70659]:       <target dev="tap3b7df7d2-e4"/>
Jul 25 17:06:35 user nova-compute[70659]:     </interface>
Jul 25 17:06:35 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:06:35 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/8cf2697d-18c1-49bd-9f7f-08885d943672/console.log" append="off"/>
Jul 25 17:06:35 user nova-compute[70659]:     </serial>
Jul 25 17:06:35 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:06:35 user nova-compute[70659]:     <video>
Jul 25 17:06:35 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:06:35 user nova-compute[70659]:     </video>
Jul 25 17:06:35 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:06:35 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:06:35 user nova-compute[70659]:     </rng>
Jul 25 17:06:35 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:06:35 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:06:35 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:06:35 user nova-compute[70659]:     </memballoon>
Jul 25 17:06:35 user nova-compute[70659]:   </devices>
Jul 25 17:06:35 user nova-compute[70659]: </domain>
Jul 25 17:06:35 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385776309',display_name='tempest-TestShelveInstance-server-1385776309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385776309',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfS7GX2feKTnfrOaK06MJipk+KIrTAhOCa2C2a/Ye7ImGNYQ+C55l3y85Amnav7T5TbVBED5Ch9B2LsPgo7UEH3fC9jrWXUwMvUgcG2wf3WoW0jsTnUS90XFRIDQUyTsg==',key_name='tempest-TestShelveInstance-1694808483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930ca993f8d04c03b073fbe183f064de',ramdisk_id='',reservation_id='r-tc9ckny8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-396312487',owner_user_name='tempest-TestShelveInstance-396312487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:06:25Z,user_data=None,user_id='7c9f4887220e4691b50538353a898b73',uuid=8cf2697d-18c1-49bd-9f7f-08885d943672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converting VIF {"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG os_vif [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b7df7d2-e4, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b7df7d2-e4, col_values=(('external_ids', {'iface-id': '3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:31:55', 'vm-uuid': '8cf2697d-18c1-49bd-9f7f-08885d943672'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:35 user nova-compute[70659]: INFO os_vif [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4')
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:06:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] No VIF found with MAC fa:16:3e:22:31:55, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:06:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-c4091270-f83c-4f88-b2ff-7074b729e169 req-7be1cafa-2cb5-4ec9-b442-0e8d66a3b493 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4091270-f83c-4f88-b2ff-7074b729e169 req-7be1cafa-2cb5-4ec9-b442-0e8d66a3b493 service nova] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4091270-f83c-4f88-b2ff-7074b729e169 req-7be1cafa-2cb5-4ec9-b442-0e8d66a3b493 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c4091270-f83c-4f88-b2ff-7074b729e169 req-7be1cafa-2cb5-4ec9-b442-0e8d66a3b493 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-c4091270-f83c-4f88-b2ff-7074b729e169 req-7be1cafa-2cb5-4ec9-b442-0e8d66a3b493 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] No waiting events found dispatching network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:36 user nova-compute[70659]: WARNING nova.compute.manager [req-c4091270-f83c-4f88-b2ff-7074b729e169 req-7be1cafa-2cb5-4ec9-b442-0e8d66a3b493 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received unexpected event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a for instance with vm_state building and task_state spawning.
Jul 25 17:06:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304798.515601, 8cf2697d-18c1-49bd-9f7f-08885d943672 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:06:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] VM Resumed (Lifecycle Event)
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:06:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Instance spawned successfully.
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:06:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304798.51659, 8cf2697d-18c1-49bd-9f7f-08885d943672 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:06:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] VM Started (Lifecycle Event)
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:06:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:06:38 user nova-compute[70659]: INFO nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Took 5.01 seconds to spawn the instance on the hypervisor.
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:06:38 user nova-compute[70659]: INFO nova.compute.manager [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Took 13.77 seconds to build instance.
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-508e3bdf-cca2-4cde-845b-822044f34730 req-4c906db1-7135-4866-b144-a0a2c87e3ba7 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-508e3bdf-cca2-4cde-845b-822044f34730 req-4c906db1-7135-4866-b144-a0a2c87e3ba7 service nova] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-508e3bdf-cca2-4cde-845b-822044f34730 req-4c906db1-7135-4866-b144-a0a2c87e3ba7 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-508e3bdf-cca2-4cde-845b-822044f34730 req-4c906db1-7135-4866-b144-a0a2c87e3ba7 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-508e3bdf-cca2-4cde-845b-822044f34730 req-4c906db1-7135-4866-b144-a0a2c87e3ba7 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] No waiting events found dispatching network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:38 user nova-compute[70659]: WARNING nova.compute.manager [req-508e3bdf-cca2-4cde-845b-822044f34730 req-4c906db1-7135-4866-b144-a0a2c87e3ba7 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received unexpected event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a for instance with vm_state active and task_state None.
Jul 25 17:06:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-0e6e050b-6af2-4e5d-a8c9-7b8af80919cc tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.893s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:48 user nova-compute[70659]: INFO nova.compute.manager [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Terminating instance
Jul 25 17:06:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-04af07d9-cedd-4eb6-ae70-28d65f145eda req-ebfe922a-a6ec-497e-8f54-71e2bee9451a service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received event network-vif-unplugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-04af07d9-cedd-4eb6-ae70-28d65f145eda req-ebfe922a-a6ec-497e-8f54-71e2bee9451a service nova] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-04af07d9-cedd-4eb6-ae70-28d65f145eda req-ebfe922a-a6ec-497e-8f54-71e2bee9451a service nova] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-04af07d9-cedd-4eb6-ae70-28d65f145eda req-ebfe922a-a6ec-497e-8f54-71e2bee9451a service nova] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-04af07d9-cedd-4eb6-ae70-28d65f145eda req-ebfe922a-a6ec-497e-8f54-71e2bee9451a service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] No waiting events found dispatching network-vif-unplugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-04af07d9-cedd-4eb6-ae70-28d65f145eda req-ebfe922a-a6ec-497e-8f54-71e2bee9451a service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received event network-vif-unplugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:06:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Instance destroyed successfully.
Jul 25 17:06:48 user nova-compute[70659]: DEBUG nova.objects.instance [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'resources' on Instance uuid 77750821-16ee-4945-88ff-a8445edab24b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1645951941',display_name='tempest-AttachVolumeNegativeTest-server-1645951941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1645951941',id=32,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfKz2QfldCQ7KV3nou0/5ibHe4YwqsJp8Gvw+THphFYUzkk4PViFhVIO8WEh1bZxkibqFwQ+iazBeMi/+cJA443sE5Km6CpVpFaro8bE8dtzdBevOHR0iFS9SIGLXFr0A==',key_name='tempest-keypair-1819778944',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-25g77lzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=77750821-16ee-4945-88ff-a8445edab24b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "address": "fa:16:3e:6a:fb:de", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c6378e0-e9", "ovs_interfaceid": "2c6378e0-e987-4aeb-93e7-d8ee73aead01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=2c6378e0-e987-4aeb-93e7-d8ee73aead01,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6378e0-e9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG os_vif [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=2c6378e0-e987-4aeb-93e7-d8ee73aead01,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6378e0-e9') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c6378e0-e9, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:48 user nova-compute[70659]: INFO os_vif [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=2c6378e0-e987-4aeb-93e7-d8ee73aead01,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c6378e0-e9')
Jul 25 17:06:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Deleting instance files /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b_del
Jul 25 17:06:49 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Deletion of /opt/stack/data/nova/instances/77750821-16ee-4945-88ff-a8445edab24b_del complete
Jul 25 17:06:49 user nova-compute[70659]: INFO nova.compute.manager [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 25 17:06:49 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:06:49 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:06:49 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 77750821-16ee-4945-88ff-a8445edab24b] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:06:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:06:50 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Took 0.96 seconds to deallocate network for instance.
Jul 25 17:06:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-9d6e2386-f844-46d4-b210-5238effa915a req-f46a8775-02a7-402a-871b-dd0969406073 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received event network-vif-deleted-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:50 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Deleted allocations for instance 77750821-16ee-4945-88ff-a8445edab24b
Jul 25 17:06:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-2bdb282e-6937-498c-aa5f-14029af73181 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "77750821-16ee-4945-88ff-a8445edab24b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.392s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-50cc224e-969d-4993-b163-c56d97404847 req-a7dddd2b-3e2e-481c-807a-f3873de86cb5 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received event network-vif-plugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50cc224e-969d-4993-b163-c56d97404847 req-a7dddd2b-3e2e-481c-807a-f3873de86cb5 service nova] Acquiring lock "77750821-16ee-4945-88ff-a8445edab24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50cc224e-969d-4993-b163-c56d97404847 req-a7dddd2b-3e2e-481c-807a-f3873de86cb5 service nova] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50cc224e-969d-4993-b163-c56d97404847 req-a7dddd2b-3e2e-481c-807a-f3873de86cb5 service nova] Lock "77750821-16ee-4945-88ff-a8445edab24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:06:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-50cc224e-969d-4993-b163-c56d97404847 req-a7dddd2b-3e2e-481c-807a-f3873de86cb5 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] No waiting events found dispatching network-vif-plugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:06:50 user nova-compute[70659]: WARNING nova.compute.manager [req-50cc224e-969d-4993-b163-c56d97404847 req-a7dddd2b-3e2e-481c-807a-f3873de86cb5 service nova] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Received unexpected event network-vif-plugged-2c6378e0-e987-4aeb-93e7-d8ee73aead01 for instance with vm_state deleted and task_state None.
Jul 25 17:06:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:06:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:06:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:06:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:03 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304808.94951, 77750821-16ee-4945-88ff-a8445edab24b => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:07:03 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 77750821-16ee-4945-88ff-a8445edab24b] VM Stopped (Lifecycle Event)
Jul 25 17:07:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5826c43c-0cd6-40f1-a081-861b907b9a27 None None] [instance: 77750821-16ee-4945-88ff-a8445edab24b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:07:04 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:07:04 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7778MB free_disk=25.025169372558594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e006724d-e45a-405f-9084-544925aaa8ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 856974f4-fd81-4d22-a316-5e08c36e35d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 8cf2697d-18c1-49bd-9f7f-08885d943672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:07:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:06 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:06 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:07:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:07:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:07:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:07:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating instance_info_cache with network_info: [{"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:07:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-a0f3fc7c-0f44-450b-a4c3-f628aad189ae" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:07:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:07:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 17:07:18 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:07:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:23 user nova-compute[70659]: INFO nova.compute.manager [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Terminating instance
Jul 25 17:07:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:07:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-2dd5af4c-6e7b-4a25-89e4-5b45a134b149 req-cc4fdb12-75eb-4f8f-8fac-3f50bea8e12d service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-unplugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2dd5af4c-6e7b-4a25-89e4-5b45a134b149 req-cc4fdb12-75eb-4f8f-8fac-3f50bea8e12d service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2dd5af4c-6e7b-4a25-89e4-5b45a134b149 req-cc4fdb12-75eb-4f8f-8fac-3f50bea8e12d service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2dd5af4c-6e7b-4a25-89e4-5b45a134b149 req-cc4fdb12-75eb-4f8f-8fac-3f50bea8e12d service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-2dd5af4c-6e7b-4a25-89e4-5b45a134b149 req-cc4fdb12-75eb-4f8f-8fac-3f50bea8e12d service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-unplugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-2dd5af4c-6e7b-4a25-89e4-5b45a134b149 req-cc4fdb12-75eb-4f8f-8fac-3f50bea8e12d service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-unplugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Instance destroyed successfully.
Jul 25 17:07:24 user nova-compute[70659]: DEBUG nova.objects.instance [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'resources' on Instance uuid a0f3fc7c-0f44-450b-a4c3-f628aad189ae {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1276348519',display_name='tempest-TestMinimumBasicScenario-server-1276348519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1276348519',id=34,image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP7iY75WewGd9w81yWLG0+aApzmPP1DdnbLIGJQjie10aI09rJyALWMwmNsSC+MotNHXs0rY3nOs6ehU+vvWvLRQsTX4H6VMaF2oCf/W+ixdSGtoMeVNIXKH6grRAXuEg==',key_name='tempest-TestMinimumBasicScenario-342159585',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='775d6e7c342a492f815f2c68c62b291a',ramdisk_id='',reservation_id='r-kqj3kgb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d716fbcf-6acb-4e7a-8a8b-5f6a6bb4712f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-866741703',owner_user_name='tempest-TestMinimumBasicScenario-866741703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:04:44Z,user_data=None,user_id='b14f37927ee848b890ec02b3068251f3',uuid=a0f3fc7c-0f44-450b-a4c3-f628aad189ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converting VIF {"id": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "address": "fa:16:3e:66:54:bd", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebdedf5d-69", "ovs_interfaceid": "ebdedf5d-69f8-4141-a81c-301b7347b9c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG os_vif [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebdedf5d-69, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:07:24 user nova-compute[70659]: INFO os_vif [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:54:bd,bridge_name='br-int',has_traffic_filtering=True,id=ebdedf5d-69f8-4141-a81c-301b7347b9c4,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebdedf5d-69')
Jul 25 17:07:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Deleting instance files /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae_del
Jul 25 17:07:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Deletion of /opt/stack/data/nova/instances/a0f3fc7c-0f44-450b-a4c3-f628aad189ae_del complete
Jul 25 17:07:24 user nova-compute[70659]: INFO nova.compute.manager [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 25 17:07:24 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:07:24 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:07:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:25 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:07:25 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Took 1.05 seconds to deallocate network for instance.
Jul 25 17:07:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:26 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Deleted allocations for instance a0f3fc7c-0f44-450b-a4c3-f628aad189ae
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bf4be2f7-0260-41a6-b7f5-bddea6c67b6e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.430s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:07:26 user nova-compute[70659]: WARNING nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received unexpected event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with vm_state deleted and task_state None.
Jul 25 17:07:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:07:26 user nova-compute[70659]: WARNING nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received unexpected event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with vm_state deleted and task_state None.
Jul 25 17:07:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] Acquiring lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] Lock "a0f3fc7c-0f44-450b-a4c3-f628aad189ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] No waiting events found dispatching network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:07:26 user nova-compute[70659]: WARNING nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received unexpected event network-vif-plugged-ebdedf5d-69f8-4141-a81c-301b7347b9c4 for instance with vm_state deleted and task_state None.
Jul 25 17:07:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-5729227f-3a9f-4dc2-acd6-9bdae23cb54a req-198b5468-f467-490e-9f89-abed5c2d959a service nova] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Received event network-vif-deleted-ebdedf5d-69f8-4141-a81c-301b7347b9c4 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:07:34 user nova-compute[70659]: INFO nova.compute.claims [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Claim successful on node user
Jul 25 17:07:34 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:07:34 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:07:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:07:34 user nova-compute[70659]: INFO nova.virt.block_device [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Booting with volume dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 at /dev/vda
Jul 25 17:07:34 user nova-compute[70659]: DEBUG nova.policy [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f29db3ae5934862b72e71e6863b46a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a3bf6c11a04274b5059bd9dd6be00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG os_brick.utils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ac2689-9853-45a5-8309-03742ff55a22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b311c02f-425b-4617-bd7a-855394ccfc4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[727a1762-7706-4f9b-a030-7b758ad527f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc5262f-9efe-4238-be30-d2c76b2f7ab4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:07:35 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:07:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced63ad4-99aa-4e6d-8468-eaede54cfa79]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG os_brick.utils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating existing volume attachment record: f3befef1-2e39-4b26-9635-ea46c520adf5 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:07:35 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Successfully created port: 182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Successfully updated port: 182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquired lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-d3fe6151-2812-4fb3-abf3-a5a1dd7fda4d req-0474c716-7c28-49e8-a949-87690751257d service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-changed-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-d3fe6151-2812-4fb3-abf3-a5a1dd7fda4d req-0474c716-7c28-49e8-a949-87690751257d service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Refreshing instance network info cache due to event network-changed-182ef6f0-865b-4e16-89c8-9b57ace1d272. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d3fe6151-2812-4fb3-abf3-a5a1dd7fda4d req-0474c716-7c28-49e8-a949-87690751257d service nova] Acquiring lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating instance_info_cache with network_info: [{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Releasing lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Instance network_info: |[{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d3fe6151-2812-4fb3-abf3-a5a1dd7fda4d req-0474c716-7c28-49e8-a949-87690751257d service nova] Acquired lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:07:36 user nova-compute[70659]: DEBUG nova.network.neutron [req-d3fe6151-2812-4fb3-abf3-a5a1dd7fda4d req-0474c716-7c28-49e8-a949-87690751257d service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Refreshing network info cache for port 182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:07:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-d3fe6151-2812-4fb3-abf3-a5a1dd7fda4d req-0474c716-7c28-49e8-a949-87690751257d service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updated VIF entry in instance network info cache for port 182ef6f0-865b-4e16-89c8-9b57ace1d272. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:07:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-d3fe6151-2812-4fb3-abf3-a5a1dd7fda4d req-0474c716-7c28-49e8-a949-87690751257d service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating instance_info_cache with network_info: [{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:07:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d3fe6151-2812-4fb3-abf3-a5a1dd7fda4d req-0474c716-7c28-49e8-a949-87690751257d service nova] Releasing lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:07:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:39 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304844.698387, a0f3fc7c-0f44-450b-a4c3-f628aad189ae => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:07:39 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] VM Stopped (Lifecycle Event)
Jul 25 17:07:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4285f188-22e8-463b-a4e8-f58e41fe1df7 None None] [instance: a0f3fc7c-0f44-450b-a4c3-f628aad189ae] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:07:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:07:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:07:41 user nova-compute[70659]: INFO nova.compute.claims [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Claim successful on node user
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:07:42 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Creating image(s)
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Ensure instance console log exists: /opt/stack/data/nova/instances/940f2d84-8561-4345-a291-819dc67abba8/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Start _get_guest_xml network_info=[{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f3befef1-2e39-4b26-9635-ea46c520adf5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdMEbPGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '940f2d84-8561-4345-a291-819dc67abba8', 'attached_at': '', 'detached_at': '', 'volume_id': 'dad3d12e-5a7f-4a92-8ab9-8413cbee0a98', 'serial': 'dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:07:42 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:07:42 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdMEbPGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:07:42 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:07:42 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:07:42 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d584012a-3325-4a99-bdeb-299ac94d77a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:07:42 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[de69dc17-9626-4158-a268-ea0e38687cb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98] added
Jul 25 17:07:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bda7f3-ea1b-40c3-8069-2530b6103d27]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b0625b-1a5c-42de-8b84-1ca0dc210924]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdMEbPGq {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdMEbPGq" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca6409c-fa4e-449d-9af9-5798a925ef9e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KdMEbPGq'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[946b103b-312d-450e-a2db-6e596b994087]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a97fa-53df-479d-afe8-5e11a598e0b4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7694f4-37b2-4b15-b0f2-ed495443cca4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260]
Jul 25 17:07:42 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260] successful.
Jul 25 17:07:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7e81ee-6668-4100-812e-a955f1dfc577]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f604184-1c62-4cc3-91d5-e26828f5ccad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:07:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f81b3b5-17dd-47fa-b2e9-6127614ea660]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdMEbPGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.network.neutron [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:07:42 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.policy [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e925fbb88b3e433abd27fa08a766e4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ed4eae8755454c9e5be953e69c013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:07:42 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Creating image(s)
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "/opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "/opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk 1073741824" returned: 0 in 0.054s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Cannot resize image /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'migration_context' on Instance uuid fdea0673-35e9-4e1f-be7c-dc942986dc89 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Ensure instance console log exists: /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23332376161333334', 'path': '/dev/sde'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332376161333334', 'path': '/dev/sde'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-997832181',display_name='tempest-ServerActionsTestOtherA-server-997832181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-997832181',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-a151piun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=940f2d84-8561-4345-a291-819dc67abba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'pci_devices' on Instance uuid 940f2d84-8561-4345-a291-819dc67abba8 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:07:43 user nova-compute[70659]:   <uuid>940f2d84-8561-4345-a291-819dc67abba8</uuid>
Jul 25 17:07:43 user nova-compute[70659]:   <name>instance-00000027</name>
Jul 25 17:07:43 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:07:43 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:07:43 user nova-compute[70659]:   <metadata>
Jul 25 17:07:43 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:07:43 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:07:43 user nova-compute[70659]:       <nova:name>tempest-ServerActionsTestOtherA-server-997832181</nova:name>
Jul 25 17:07:43 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:07:42</nova:creationTime>
Jul 25 17:07:43 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:07:43 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:07:43 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:07:43 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:07:43 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:07:43 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:07:43 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:07:43 user nova-compute[70659]:       <nova:owner>
Jul 25 17:07:43 user nova-compute[70659]:         <nova:user uuid="4f29db3ae5934862b72e71e6863b46a6">tempest-ServerActionsTestOtherA-1965201562-project-member</nova:user>
Jul 25 17:07:43 user nova-compute[70659]:         <nova:project uuid="77a3bf6c11a04274b5059bd9dd6be00e">tempest-ServerActionsTestOtherA-1965201562</nova:project>
Jul 25 17:07:43 user nova-compute[70659]:       </nova:owner>
Jul 25 17:07:43 user nova-compute[70659]:       <nova:ports>
Jul 25 17:07:43 user nova-compute[70659]:         <nova:port uuid="182ef6f0-865b-4e16-89c8-9b57ace1d272">
Jul 25 17:07:43 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 17:07:43 user nova-compute[70659]:         </nova:port>
Jul 25 17:07:43 user nova-compute[70659]:       </nova:ports>
Jul 25 17:07:43 user nova-compute[70659]:     </nova:instance>
Jul 25 17:07:43 user nova-compute[70659]:   </metadata>
Jul 25 17:07:43 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:07:43 user nova-compute[70659]:     <system>
Jul 25 17:07:43 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:07:43 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:07:43 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:07:43 user nova-compute[70659]:       <entry name="serial">940f2d84-8561-4345-a291-819dc67abba8</entry>
Jul 25 17:07:43 user nova-compute[70659]:       <entry name="uuid">940f2d84-8561-4345-a291-819dc67abba8</entry>
Jul 25 17:07:43 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:07:43 user nova-compute[70659]:     </system>
Jul 25 17:07:43 user nova-compute[70659]:   </sysinfo>
Jul 25 17:07:43 user nova-compute[70659]:   <os>
Jul 25 17:07:43 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:07:43 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:07:43 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:07:43 user nova-compute[70659]:   </os>
Jul 25 17:07:43 user nova-compute[70659]:   <features>
Jul 25 17:07:43 user nova-compute[70659]:     <acpi/>
Jul 25 17:07:43 user nova-compute[70659]:     <apic/>
Jul 25 17:07:43 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:07:43 user nova-compute[70659]:   </features>
Jul 25 17:07:43 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:07:43 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:07:43 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:07:43 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:07:43 user nova-compute[70659]:   </clock>
Jul 25 17:07:43 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:07:43 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:07:43 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:07:43 user nova-compute[70659]:   </cpu>
Jul 25 17:07:43 user nova-compute[70659]:   <devices>
Jul 25 17:07:43 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:07:43 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:07:43 user nova-compute[70659]:       <source dev="/dev/sde"/>
Jul 25 17:07:43 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:07:43 user nova-compute[70659]:       <serial>dad3d12e-5a7f-4a92-8ab9-8413cbee0a98</serial>
Jul 25 17:07:43 user nova-compute[70659]:     </disk>
Jul 25 17:07:43 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:07:43 user nova-compute[70659]:       <mac address="fa:16:3e:80:67:ef"/>
Jul 25 17:07:43 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:07:43 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:07:43 user nova-compute[70659]:       <target dev="tap182ef6f0-86"/>
Jul 25 17:07:43 user nova-compute[70659]:     </interface>
Jul 25 17:07:43 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:07:43 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/940f2d84-8561-4345-a291-819dc67abba8/console.log" append="off"/>
Jul 25 17:07:43 user nova-compute[70659]:     </serial>
Jul 25 17:07:43 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:07:43 user nova-compute[70659]:     <video>
Jul 25 17:07:43 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:07:43 user nova-compute[70659]:     </video>
Jul 25 17:07:43 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:07:43 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:07:43 user nova-compute[70659]:     </rng>
Jul 25 17:07:43 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:07:43 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:07:43 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:07:43 user nova-compute[70659]:     </memballoon>
Jul 25 17:07:43 user nova-compute[70659]:   </devices>
Jul 25 17:07:43 user nova-compute[70659]: </domain>
Jul 25 17:07:43 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-997832181',display_name='tempest-ServerActionsTestOtherA-server-997832181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-997832181',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-a151piun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=940f2d84-8561-4345-a291-819dc67abba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG os_vif [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.network.neutron [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Successfully created port: b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap182ef6f0-86, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap182ef6f0-86, col_values=(('external_ids', {'iface-id': '182ef6f0-865b-4e16-89c8-9b57ace1d272', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:67:ef', 'vm-uuid': '940f2d84-8561-4345-a291-819dc67abba8'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:43 user nova-compute[70659]: INFO os_vif [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86')
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:07:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No VIF found with MAC fa:16:3e:80:67:ef, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Successfully updated port: b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "refresh_cache-fdea0673-35e9-4e1f-be7c-dc942986dc89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquired lock "refresh_cache-fdea0673-35e9-4e1f-be7c-dc942986dc89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-e754f525-dc10-46d3-abb3-6275a533148d req-9bef5a68-2b83-4c14-bd8b-7f7c15b9b1f2 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received event network-changed-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-e754f525-dc10-46d3-abb3-6275a533148d req-9bef5a68-2b83-4c14-bd8b-7f7c15b9b1f2 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Refreshing instance network info cache due to event network-changed-b63b7573-ab84-4a4a-97bb-7321bc01cb75. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e754f525-dc10-46d3-abb3-6275a533148d req-9bef5a68-2b83-4c14-bd8b-7f7c15b9b1f2 service nova] Acquiring lock "refresh_cache-fdea0673-35e9-4e1f-be7c-dc942986dc89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Updating instance_info_cache with network_info: [{"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Releasing lock "refresh_cache-fdea0673-35e9-4e1f-be7c-dc942986dc89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Instance network_info: |[{"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e754f525-dc10-46d3-abb3-6275a533148d req-9bef5a68-2b83-4c14-bd8b-7f7c15b9b1f2 service nova] Acquired lock "refresh_cache-fdea0673-35e9-4e1f-be7c-dc942986dc89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.network.neutron [req-e754f525-dc10-46d3-abb3-6275a533148d req-9bef5a68-2b83-4c14-bd8b-7f7c15b9b1f2 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Refreshing network info cache for port b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Start _get_guest_xml network_info=[{"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:07:44 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:07:44 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1126408480',display_name='tempest-AttachVolumeNegativeTest-server-1126408480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1126408480',id=40,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdzTFMrYz3BnVgFLfAvyjBYzQE+XGgIfiPjeN+qakfVifcMk04JiVmjPrc/AD0FXJHD9VwcY4WjC9KjuJtPu0ba+BWg6L8rlKDlw/dJ9k+dhAQlOLoo9reely9xSVJE1w==',key_name='tempest-keypair-1003027889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-7d87bfnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=fdea0673-35e9-4e1f-be7c-dc942986dc89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:eb:51,bridge_name='br-int',has_traffic_filtering=True,id=b63b7573-ab84-4a4a-97bb-7321bc01cb75,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63b7573-ab') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'pci_devices' on Instance uuid fdea0673-35e9-4e1f-be7c-dc942986dc89 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:07:44 user nova-compute[70659]:   <uuid>fdea0673-35e9-4e1f-be7c-dc942986dc89</uuid>
Jul 25 17:07:44 user nova-compute[70659]:   <name>instance-00000028</name>
Jul 25 17:07:44 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:07:44 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:07:44 user nova-compute[70659]:   <metadata>
Jul 25 17:07:44 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:07:44 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:07:44 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1126408480</nova:name>
Jul 25 17:07:44 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:07:44</nova:creationTime>
Jul 25 17:07:44 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:07:44 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:07:44 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:07:44 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:07:44 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:07:44 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:07:44 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:07:44 user nova-compute[70659]:       <nova:owner>
Jul 25 17:07:44 user nova-compute[70659]:         <nova:user uuid="e925fbb88b3e433abd27fa08a766e4e8">tempest-AttachVolumeNegativeTest-921778031-project-member</nova:user>
Jul 25 17:07:44 user nova-compute[70659]:         <nova:project uuid="e5ed4eae8755454c9e5be953e69c013a">tempest-AttachVolumeNegativeTest-921778031</nova:project>
Jul 25 17:07:44 user nova-compute[70659]:       </nova:owner>
Jul 25 17:07:44 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:07:44 user nova-compute[70659]:       <nova:ports>
Jul 25 17:07:44 user nova-compute[70659]:         <nova:port uuid="b63b7573-ab84-4a4a-97bb-7321bc01cb75">
Jul 25 17:07:44 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 17:07:44 user nova-compute[70659]:         </nova:port>
Jul 25 17:07:44 user nova-compute[70659]:       </nova:ports>
Jul 25 17:07:44 user nova-compute[70659]:     </nova:instance>
Jul 25 17:07:44 user nova-compute[70659]:   </metadata>
Jul 25 17:07:44 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:07:44 user nova-compute[70659]:     <system>
Jul 25 17:07:44 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:07:44 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:07:44 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:07:44 user nova-compute[70659]:       <entry name="serial">fdea0673-35e9-4e1f-be7c-dc942986dc89</entry>
Jul 25 17:07:44 user nova-compute[70659]:       <entry name="uuid">fdea0673-35e9-4e1f-be7c-dc942986dc89</entry>
Jul 25 17:07:44 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:07:44 user nova-compute[70659]:     </system>
Jul 25 17:07:44 user nova-compute[70659]:   </sysinfo>
Jul 25 17:07:44 user nova-compute[70659]:   <os>
Jul 25 17:07:44 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:07:44 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:07:44 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:07:44 user nova-compute[70659]:   </os>
Jul 25 17:07:44 user nova-compute[70659]:   <features>
Jul 25 17:07:44 user nova-compute[70659]:     <acpi/>
Jul 25 17:07:44 user nova-compute[70659]:     <apic/>
Jul 25 17:07:44 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:07:44 user nova-compute[70659]:   </features>
Jul 25 17:07:44 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:07:44 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:07:44 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:07:44 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:07:44 user nova-compute[70659]:   </clock>
Jul 25 17:07:44 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:07:44 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:07:44 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:07:44 user nova-compute[70659]:   </cpu>
Jul 25 17:07:44 user nova-compute[70659]:   <devices>
Jul 25 17:07:44 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:07:44 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:07:44 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk"/>
Jul 25 17:07:44 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:07:44 user nova-compute[70659]:     </disk>
Jul 25 17:07:44 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:07:44 user nova-compute[70659]:       <mac address="fa:16:3e:95:eb:51"/>
Jul 25 17:07:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:07:44 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:07:44 user nova-compute[70659]:       <target dev="tapb63b7573-ab"/>
Jul 25 17:07:44 user nova-compute[70659]:     </interface>
Jul 25 17:07:44 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:07:44 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/console.log" append="off"/>
Jul 25 17:07:44 user nova-compute[70659]:     </serial>
Jul 25 17:07:44 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:07:44 user nova-compute[70659]:     <video>
Jul 25 17:07:44 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:07:44 user nova-compute[70659]:     </video>
Jul 25 17:07:44 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:07:44 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:07:44 user nova-compute[70659]:     </rng>
Jul 25 17:07:44 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:07:44 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:07:44 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:07:44 user nova-compute[70659]:     </memballoon>
Jul 25 17:07:44 user nova-compute[70659]:   </devices>
Jul 25 17:07:44 user nova-compute[70659]: </domain>
Jul 25 17:07:44 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1126408480',display_name='tempest-AttachVolumeNegativeTest-server-1126408480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1126408480',id=40,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdzTFMrYz3BnVgFLfAvyjBYzQE+XGgIfiPjeN+qakfVifcMk04JiVmjPrc/AD0FXJHD9VwcY4WjC9KjuJtPu0ba+BWg6L8rlKDlw/dJ9k+dhAQlOLoo9reely9xSVJE1w==',key_name='tempest-keypair-1003027889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-7d87bfnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=fdea0673-35e9-4e1f-be7c-dc942986dc89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:eb:51,bridge_name='br-int',has_traffic_filtering=True,id=b63b7573-ab84-4a4a-97bb-7321bc01cb75,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63b7573-ab') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG os_vif [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:eb:51,bridge_name='br-int',has_traffic_filtering=True,id=b63b7573-ab84-4a4a-97bb-7321bc01cb75,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63b7573-ab') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb63b7573-ab, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb63b7573-ab, col_values=(('external_ids', {'iface-id': 'b63b7573-ab84-4a4a-97bb-7321bc01cb75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:eb:51', 'vm-uuid': 'fdea0673-35e9-4e1f-be7c-dc942986dc89'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:07:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:44 user nova-compute[70659]: INFO os_vif [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:eb:51,bridge_name='br-int',has_traffic_filtering=True,id=b63b7573-ab84-4a4a-97bb-7321bc01cb75,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63b7573-ab')
Jul 25 17:07:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No VIF found with MAC fa:16:3e:95:eb:51, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-8da8d8b9-95dd-4d9b-89af-6f41b6cf48d1 req-73800177-9464-4a8b-bda7-5da04129ac87 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8da8d8b9-95dd-4d9b-89af-6f41b6cf48d1 req-73800177-9464-4a8b-bda7-5da04129ac87 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8da8d8b9-95dd-4d9b-89af-6f41b6cf48d1 req-73800177-9464-4a8b-bda7-5da04129ac87 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8da8d8b9-95dd-4d9b-89af-6f41b6cf48d1 req-73800177-9464-4a8b-bda7-5da04129ac87 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-8da8d8b9-95dd-4d9b-89af-6f41b6cf48d1 req-73800177-9464-4a8b-bda7-5da04129ac87 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:07:45 user nova-compute[70659]: WARNING nova.compute.manager [req-8da8d8b9-95dd-4d9b-89af-6f41b6cf48d1 req-73800177-9464-4a8b-bda7-5da04129ac87 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state building and task_state spawning.
Jul 25 17:07:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG nova.network.neutron [req-e754f525-dc10-46d3-abb3-6275a533148d req-9bef5a68-2b83-4c14-bd8b-7f7c15b9b1f2 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Updated VIF entry in instance network info cache for port b63b7573-ab84-4a4a-97bb-7321bc01cb75. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG nova.network.neutron [req-e754f525-dc10-46d3-abb3-6275a533148d req-9bef5a68-2b83-4c14-bd8b-7f7c15b9b1f2 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Updating instance_info_cache with network_info: [{"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:07:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e754f525-dc10-46d3-abb3-6275a533148d req-9bef5a68-2b83-4c14-bd8b-7f7c15b9b1f2 service nova] Releasing lock "refresh_cache-fdea0673-35e9-4e1f-be7c-dc942986dc89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:07:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:07:47 user nova-compute[70659]: WARNING nova.compute.manager [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state building and task_state spawning.
Jul 25 17:07:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received event network-vif-plugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] No waiting events found dispatching network-vif-plugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:07:47 user nova-compute[70659]: WARNING nova.compute.manager [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received unexpected event network-vif-plugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 for instance with vm_state building and task_state spawning.
Jul 25 17:07:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received event network-vif-plugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] No waiting events found dispatching network-vif-plugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:07:47 user nova-compute[70659]: WARNING nova.compute.manager [req-1ca761a3-1c98-46da-98b1-6e1fee1c5796 req-fb48a37e-e26d-47db-afdc-5cacc9a0b9d8 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received unexpected event network-vif-plugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 for instance with vm_state building and task_state spawning.
Jul 25 17:07:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304868.2107892, 940f2d84-8561-4345-a291-819dc67abba8 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:07:48 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] VM Resumed (Lifecycle Event)
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:07:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Instance spawned successfully.
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:48 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304868.2119708, 940f2d84-8561-4345-a291-819dc67abba8 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:07:48 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] VM Started (Lifecycle Event)
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:07:48 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:07:48 user nova-compute[70659]: INFO nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Took 6.32 seconds to spawn the instance on the hypervisor.
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:07:48 user nova-compute[70659]: INFO nova.compute.manager [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Took 14.05 seconds to build instance.
Jul 25 17:07:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4d6b2ffb-be81-43ff-8750-52cecdf1c1bf tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.142s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304868.978486, fdea0673-35e9-4e1f-be7c-dc942986dc89 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:07:48 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] VM Resumed (Lifecycle Event)
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:07:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Instance spawned successfully.
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:07:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:07:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304868.9840763, fdea0673-35e9-4e1f-be7c-dc942986dc89 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:07:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] VM Started (Lifecycle Event)
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:07:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:07:49 user nova-compute[70659]: INFO nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Took 6.44 seconds to spawn the instance on the hypervisor.
Jul 25 17:07:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:07:49 user nova-compute[70659]: INFO nova.compute.manager [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Took 7.22 seconds to build instance.
Jul 25 17:07:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-04751fb7-afd0-4341-8964-3424651666ba tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.318s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-58dd7881-0d47-4c1a-9911-1d4e101a0e5f req-5a325199-6be7-40fc-b269-e55b52ea5201 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received event network-changed-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:07:55 user nova-compute[70659]: DEBUG nova.compute.manager [req-58dd7881-0d47-4c1a-9911-1d4e101a0e5f req-5a325199-6be7-40fc-b269-e55b52ea5201 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Refreshing instance network info cache due to event network-changed-96efaf7d-6841-483f-8ba2-ded3327ac82f. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:07:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-58dd7881-0d47-4c1a-9911-1d4e101a0e5f req-5a325199-6be7-40fc-b269-e55b52ea5201 service nova] Acquiring lock "refresh_cache-5eb4c44f-9955-4203-a3e6-8352cd9045ee" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:07:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-58dd7881-0d47-4c1a-9911-1d4e101a0e5f req-5a325199-6be7-40fc-b269-e55b52ea5201 service nova] Acquired lock "refresh_cache-5eb4c44f-9955-4203-a3e6-8352cd9045ee" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:07:55 user nova-compute[70659]: DEBUG nova.network.neutron [req-58dd7881-0d47-4c1a-9911-1d4e101a0e5f req-5a325199-6be7-40fc-b269-e55b52ea5201 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Refreshing network info cache for port 96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:07:55 user nova-compute[70659]: DEBUG nova.network.neutron [req-58dd7881-0d47-4c1a-9911-1d4e101a0e5f req-5a325199-6be7-40fc-b269-e55b52ea5201 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Updated VIF entry in instance network info cache for port 96efaf7d-6841-483f-8ba2-ded3327ac82f. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:07:55 user nova-compute[70659]: DEBUG nova.network.neutron [req-58dd7881-0d47-4c1a-9911-1d4e101a0e5f req-5a325199-6be7-40fc-b269-e55b52ea5201 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Updating instance_info_cache with network_info: [{"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:07:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-58dd7881-0d47-4c1a-9911-1d4e101a0e5f req-5a325199-6be7-40fc-b269-e55b52ea5201 service nova] Releasing lock "refresh_cache-5eb4c44f-9955-4203-a3e6-8352cd9045ee" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lazy-loading 'flavor' on Instance uuid 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:07:56 user nova-compute[70659]: INFO nova.compute.manager [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Attaching volume ed943080-6bc5-44b9-9eeb-8f6782420ed2 to /dev/vdb
Jul 25 17:07:56 user nova-compute[70659]: DEBUG os_brick.utils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab8ebb1-084f-40fe-b7f1-1232cba47431]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f56337f-0269-4ac2-bdfe-bfe68ef17f2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e929d2f-91f4-4626-bcf9-de47cf01f145]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[050ee77f-86b0-4034-b00b-68bc16a83f09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:07:56 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:07:56 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46626d-f4f0-4140-b9b5-a7dcd7e29ab6]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG os_brick.utils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:07:56 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Updating existing volume attachment record: 67ffbbf2-ee99-4405-97a0-7b0ff23c4ddf {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:07:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:07:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:07:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:07:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:08:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gracDmxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:08:03 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:08:03 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:08:03 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[822147c0-aa3a-4d9a-a6e4-66f2e0901429]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:08:03 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e414c76-922b-4ca9-95bf-dc225e1b06a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2] added
Jul 25 17:08:03 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2213bb58-9772-45dd-86c5-fe501f9c2505]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a184d50b-4803-49f9-92b3-3392abb4b8af]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gracDmxe {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gracDmxe" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[62efaaba-0e8e-4368-a8d8-d888d4ff941c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gracDmxe'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5476a55d-6d98-4067-b3e5-b56509fc9470]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbea6ef-5452-495e-ad72-01ddda3db2c6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e7deb6-eba6-4be6-a07b-0c949947dc87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2, portal: 172.16.0.220,3260]
Jul 25 17:08:03 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2, portal: 172.16.0.220,3260] successful.
Jul 25 17:08:03 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed240de-d396-4bd3-bab9-36f5212c3c0e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0821697-bda0-4bfd-830c-bff892b02ab0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:03 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9935e3b-2cc1-44e1-a0d2-e7f1cc37d3ce]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gracDmxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23763306438656637', 'path': '/dev/sdf'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763306438656637', 'path': '/dev/sdf'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lazy-loading 'flavor' on Instance uuid 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:08:04 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:08:04 user nova-compute[70659]:   <source dev="/dev/sdf"/>
Jul 25 17:08:04 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:08:04 user nova-compute[70659]:   <serial>ed943080-6bc5-44b9-9eeb-8f6782420ed2</serial>
Jul 25 17:08:04 user nova-compute[70659]: </disk>
Jul 25 17:08:04 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:05 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:08:05 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7633MB free_disk=25.01557159423828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] No VIF found with MAC fa:16:3e:8b:30:1a, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a0d43d2f-bd68-4cb7-92b4-b2c9313ecd83 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.115s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance e006724d-e45a-405f-9084-544925aaa8ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 856974f4-fd81-4d22-a316-5e08c36e35d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 8cf2697d-18c1-49bd-9f7f-08885d943672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 940f2d84-8561-4345-a291-819dc67abba8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fdea0673-35e9-4e1f-be7c-dc942986dc89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:08:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG nova.objects.instance [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lazy-loading 'flavor' on Instance uuid 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:08 user nova-compute[70659]: INFO nova.compute.manager [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Attaching volume d93a983d-9605-4cdc-809d-0d7e63db9b48 to /dev/vdc
Jul 25 17:08:08 user nova-compute[70659]: DEBUG os_brick.utils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[af65de4a-c6fb-4f6b-8484-babdb41b8cc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[840a0c84-4d9d-4cf9-8e57-60dd462d0765]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1709ca-34b5-4d80-9307-f7abbe547364]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b848ebbd-adad-4b17-ad4d-1f3bf1cfaa6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:08:08 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1253b6f5-1bd4-4b4b-8f80-a210d4f6095a]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG os_brick.utils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Updating existing volume attachment record: 3b507a4b-33ab-403d-a8ad-70723e711298 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:08:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:08:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:08:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:08:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:08:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:08:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:08:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Updating instance_info_cache with network_info: [{"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:08:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-856974f4-fd81-4d22-a316-5e08c36e35d6" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:08:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:10 user nova-compute[70659]: INFO nova.compute.manager [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Terminating instance
Jul 25 17:08:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-44c478d6-28e1-405b-b95b-edd97f0f5c0b req-99f1152c-c299-4a3c-9da3-59151bb5a5ff service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-44c478d6-28e1-405b-b95b-edd97f0f5c0b req-99f1152c-c299-4a3c-9da3-59151bb5a5ff service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-44c478d6-28e1-405b-b95b-edd97f0f5c0b req-99f1152c-c299-4a3c-9da3-59151bb5a5ff service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-44c478d6-28e1-405b-b95b-edd97f0f5c0b req-99f1152c-c299-4a3c-9da3-59151bb5a5ff service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-44c478d6-28e1-405b-b95b-edd97f0f5c0b req-99f1152c-c299-4a3c-9da3-59151bb5a5ff service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-44c478d6-28e1-405b-b95b-edd97f0f5c0b req-99f1152c-c299-4a3c-9da3-59151bb5a5ff service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Instance destroyed successfully.
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.objects.instance [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'resources' on Instance uuid 856974f4-fd81-4d22-a316-5e08c36e35d6 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1495572339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1495572339',id=35,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:04:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-llo3qz24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:06:24Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=856974f4-fd81-4d22-a316-5e08c36e35d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "69c79a6b-1381-4a30-bf75-896997767587", "address": "fa:16:3e:f8:b1:ff", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c79a6b-13", "ovs_interfaceid": "69c79a6b-1381-4a30-bf75-896997767587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:b1:ff,bridge_name='br-int',has_traffic_filtering=True,id=69c79a6b-1381-4a30-bf75-896997767587,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c79a6b-13') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_vif [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:b1:ff,bridge_name='br-int',has_traffic_filtering=True,id=69c79a6b-1381-4a30-bf75-896997767587,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c79a6b-13') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69c79a6b-13, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: INFO os_vif [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:b1:ff,bridge_name='br-int',has_traffic_filtering=True,id=69c79a6b-1381-4a30-bf75-896997767587,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c79a6b-13')
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPoCRjte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:08:11 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[97efbb8f-8cfa-4b13-b119-2c1c42408460]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7178513b-5802-4a14-9232-3643a944a583]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:11 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:08:11 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:11 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:11 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:11 user nova-compute[70659]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a (non-flash)
Jul 25 17:08:11 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:11 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:11 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd281fb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e49604-32df-46bf-9d51-88603f632d5d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d98bcb-75a2-4da6-a66a-9b8a97e583d9]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d6e31d-b38c-4fa2-971e-68802f1181c2]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01e0642-f251-444f-9b4d-d5a6b5fa51fe]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a8d5e711', '/dev/disk/by-id/scsi-1SCST_BIOa8d5e711-af868889e1bd5d29', '/dev/disk/by-id/scsi-26166383638383839') {{(pid=81811) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2732e86c-a5b9-4d34-bfda-0f32de50feea]: (4, None) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3b503d-4003-42aa-8dc1-ab671866dabb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d1c721-b9ec-4872-a76d-971778608903]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a, portal: 172.16.0.220,3260]
Jul 25 17:08:11 user nova-compute[70659]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a, portal: 172.16.0.220,3260] successful.
Jul 25 17:08:11 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd765297-1ef5-4ad5-81e4-d5548b2d080a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.091s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55f0dcb-081c-4f33-9e04-bfb14d750c87]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] <== disconnect_volume: return (445ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:08:11 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Deleting instance files /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6_del
Jul 25 17:08:11 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Deletion of /opt/stack/data/nova/instances/856974f4-fd81-4d22-a316-5e08c36e35d6_del complete
Jul 25 17:08:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:11 user nova-compute[70659]: INFO nova.compute.manager [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Took 1.43 seconds to destroy the instance on the hypervisor.
Jul 25 17:08:11 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:08:11 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:08:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:12 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:08:12 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Took 0.66 seconds to deallocate network for instance.
Jul 25 17:08:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-88df890d-13be-46be-b3a0-62ecf958cb96 req-e9662599-f60c-4762-8169-27cb72e377ee service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-deleted-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:13 user nova-compute[70659]: WARNING nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state active and task_state deleting.
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:13 user nova-compute[70659]: WARNING nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state active and task_state deleting.
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:13 user nova-compute[70659]: WARNING nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state active and task_state deleting.
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-unplugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Acquiring lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] No waiting events found dispatching network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:13 user nova-compute[70659]: WARNING nova.compute.manager [req-c12d4680-d408-47cb-ac85-ebaebde84c66 req-6dfb356d-501d-4ec1-8a95-fda544bc374f service nova] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Received unexpected event network-vif-plugged-69c79a6b-1381-4a30-bf75-896997767587 for instance with vm_state active and task_state deleting.
Jul 25 17:08:13 user nova-compute[70659]: INFO nova.compute.manager [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Took 0.76 seconds to detach 1 volumes for instance.
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:13 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Deleted allocations for instance 856974f4-fd81-4d22-a316-5e08c36e35d6
Jul 25 17:08:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-46716819-68f6-4762-9580-0ba44b2fe237 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "856974f4-fd81-4d22-a316-5e08c36e35d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.365s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJLYUWRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:08:15 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:08:15 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:08:15 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3db38-2278-4c58-88c8-31dda2ba6264]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:08:15 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbfda3d-fda3-488c-a8ec-3e91749c8d7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48] added
Jul 25 17:08:15 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed17a81-42f1-4b34-a008-bfccb4900899]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8348065-3ad2-4762-9995-4f26cef5cf39]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJLYUWRe {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJLYUWRe" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a844ee4a-c25f-47c6-9c6a-f8924595293f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJLYUWRe'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[520ee554-71f0-4974-98b1-f6eec384ad93]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f24b592-1315-4dd6-ae49-ad012a5aa505]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dd0e54-7807-4336-815c-6148beaa597e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48, portal: 172.16.0.220,3260]
Jul 25 17:08:16 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48, portal: 172.16.0.220,3260] successful.
Jul 25 17:08:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[62316dd6-4f2b-47fa-9d28-0acdb6593a93]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[90992db9-d426-410a-a82f-66ada5c17c44]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 (non-flash)
Jul 25 17:08:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8768a277-5d92-4d82-adf5-780beacc28fa]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJLYUWRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:08:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26130343265363437', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130343265363437', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lazy-loading 'flavor' on Instance uuid 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:08:17 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:08:17 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:08:17 user nova-compute[70659]:   <target dev="vdc" bus="virtio"/>
Jul 25 17:08:17 user nova-compute[70659]:   <serial>d93a983d-9605-4cdc-809d-0d7e63db9b48</serial>
Jul 25 17:08:17 user nova-compute[70659]: </disk>
Jul 25 17:08:17 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] No VIF found with MAC fa:16:3e:8b:30:1a, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-573d75f9-c548-4dc6-90e0-8f1990fe78b8 req-e58c7507-941c-4c0c-8167-ccedb14c5b54 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-573d75f9-c548-4dc6-90e0-8f1990fe78b8 req-e58c7507-941c-4c0c-8167-ccedb14c5b54 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing instance network info cache due to event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-573d75f9-c548-4dc6-90e0-8f1990fe78b8 req-e58c7507-941c-4c0c-8167-ccedb14c5b54 service nova] Acquiring lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-573d75f9-c548-4dc6-90e0-8f1990fe78b8 req-e58c7507-941c-4c0c-8167-ccedb14c5b54 service nova] Acquired lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-573d75f9-c548-4dc6-90e0-8f1990fe78b8 req-e58c7507-941c-4c0c-8167-ccedb14c5b54 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:08:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-48704717-4801-4a53-ab7e-9d656a25830a tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.327s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG nova.network.neutron [req-573d75f9-c548-4dc6-90e0-8f1990fe78b8 req-e58c7507-941c-4c0c-8167-ccedb14c5b54 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updated VIF entry in instance network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG nova.network.neutron [req-573d75f9-c548-4dc6-90e0-8f1990fe78b8 req-e58c7507-941c-4c0c-8167-ccedb14c5b54 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating instance_info_cache with network_info: [{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-573d75f9-c548-4dc6-90e0-8f1990fe78b8 req-e58c7507-941c-4c0c-8167-ccedb14c5b54 service nova] Releasing lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:18 user nova-compute[70659]: INFO nova.compute.manager [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Shelve offloading
Jul 25 17:08:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:08:18 user nova-compute[70659]: INFO nova.compute.claims [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Claim successful on node user
Jul 25 17:08:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:18 user nova-compute[70659]: INFO nova.compute.manager [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Detaching volume d93a983d-9605-4cdc-809d-0d7e63db9b48
Jul 25 17:08:18 user nova-compute[70659]: INFO nova.virt.block_device [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Attempting to driver detach volume d93a983d-9605-4cdc-809d-0d7e63db9b48 from mountpoint /dev/vdc
Jul 25 17:08:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Attempting to detach device vdc from instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:08:18 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:08:18 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:08:18 user nova-compute[70659]:   <target dev="vdc" bus="virtio"/>
Jul 25 17:08:18 user nova-compute[70659]:   <serial>d93a983d-9605-4cdc-809d-0d7e63db9b48</serial>
Jul 25 17:08:18 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 17:08:18 user nova-compute[70659]: </disk>
Jul 25 17:08:18 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:08:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Successfully detached device vdc from instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee from the persistent domain config.
Jul 25 17:08:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:08:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:08:18 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:08:18 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:08:18 user nova-compute[70659]:   <target dev="vdc" bus="virtio"/>
Jul 25 17:08:18 user nova-compute[70659]:   <serial>d93a983d-9605-4cdc-809d-0d7e63db9b48</serial>
Jul 25 17:08:18 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 17:08:18 user nova-compute[70659]: </disk>
Jul 25 17:08:18 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-59cc3e67-f90e-47d3-80f3-794d765f394a req-dcd2cdb6-818d-43cc-addf-c985ff55f605 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-unplugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-59cc3e67-f90e-47d3-80f3-794d765f394a req-dcd2cdb6-818d-43cc-addf-c985ff55f605 service nova] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-59cc3e67-f90e-47d3-80f3-794d765f394a req-dcd2cdb6-818d-43cc-addf-c985ff55f605 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-59cc3e67-f90e-47d3-80f3-794d765f394a req-dcd2cdb6-818d-43cc-addf-c985ff55f605 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-59cc3e67-f90e-47d3-80f3-794d765f394a req-dcd2cdb6-818d-43cc-addf-c985ff55f605 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] No waiting events found dispatching network-vif-unplugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:19 user nova-compute[70659]: WARNING nova.compute.manager [req-59cc3e67-f90e-47d3-80f3-794d765f394a req-dcd2cdb6-818d-43cc-addf-c985ff55f605 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received unexpected event network-vif-unplugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a for instance with vm_state active and task_state shelving.
Jul 25 17:08:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.network.neutron [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:08:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.policy [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b14f37927ee848b890ec02b3068251f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775d6e7c342a492f815f2c68c62b291a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:08:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Creating image(s)
Jul 25 17:08:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "/opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "/opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "/opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "301a16c1f468820443b4eb83e5f4036389b6d3e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "301a16c1f468820443b4eb83e5f4036389b6d3e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304899.5657651, 5eb4c44f-9955-4203-a3e6-8352cd9045ee => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:08:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Successfully detached device vdc from instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee from the live domain config.
Jul 25 17:08:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJLYUWRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:08:20 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:08:20 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Instance destroyed successfully.
Jul 25 17:08:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquired lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a9e8b2-4028-4ad9-b810-4833b35be9e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Successfully created port: 888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[833455b6-a54c-4a67-bdd9-75c2545a1c48]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 (non-flash)
Jul 25 17:08:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd36d35360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2.part --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG nova.virt.images [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] 49aad436-4f88-4981-b3cd-beb4d0611b7b was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2.part /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc87ef6-f921-4151-9f68-8aab556bc103]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87980b9-e317-4f8b-a35f-4620148c8db3]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac6cd72-a785-4aa9-87f2-b50eb8e68828]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97799d2-bbbd-4209-afcc-d11374dc3016]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[858c1229-5471-4542-a602-409b70e27679]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2.part /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2.converted" returned: 0 in 0.223s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2e1f5d-8881-4bb0-ace8-a1f517d19c51]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48, portal: 172.16.0.220,3260]
Jul 25 17:08:20 user nova-compute[70659]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48, portal: 172.16.0.220,3260] successful.
Jul 25 17:08:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d93a983d-9605-4cdc-809d-0d7e63db9b48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb06b0-4b70-44e7-b7c0-8e01f42cad66]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] <== disconnect_volume: return (414ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "301a16c1f468820443b4eb83e5f4036389b6d3e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.308s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2 --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "301a16c1f468820443b4eb83e5f4036389b6d3e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "301a16c1f468820443b4eb83e5f4036389b6d3e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating instance_info_cache with network_info: [{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:08:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Releasing lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2 --force-share --output=json" returned: 0 in 0.199s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2,backing_fmt=raw /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2,backing_fmt=raw /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk 1073741824" returned: 0 in 0.065s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "301a16c1f468820443b4eb83e5f4036389b6d3e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-38f1efe7-9971-40fd-b29f-54d3410903df req-40c9b09b-c34f-45b5-b253-551667a3373c service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-38f1efe7-9971-40fd-b29f-54d3410903df req-40c9b09b-c34f-45b5-b253-551667a3373c service nova] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-38f1efe7-9971-40fd-b29f-54d3410903df req-40c9b09b-c34f-45b5-b253-551667a3373c service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-38f1efe7-9971-40fd-b29f-54d3410903df req-40c9b09b-c34f-45b5-b253-551667a3373c service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-38f1efe7-9971-40fd-b29f-54d3410903df req-40c9b09b-c34f-45b5-b253-551667a3373c service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] No waiting events found dispatching network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:21 user nova-compute[70659]: WARNING nova.compute.manager [req-38f1efe7-9971-40fd-b29f-54d3410903df req-40c9b09b-c34f-45b5-b253-551667a3373c service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received unexpected event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a for instance with vm_state active and task_state shelving.
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2 --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Successfully updated port: 888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquired lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-c51324a2-2806-463f-be14-6fb9602456d0 req-ea6d293b-f64b-42db-932a-85d28080abb7 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.compute.manager [req-c51324a2-2806-463f-be14-6fb9602456d0 req-ea6d293b-f64b-42db-932a-85d28080abb7 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing instance network info cache due to event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c51324a2-2806-463f-be14-6fb9602456d0 req-ea6d293b-f64b-42db-932a-85d28080abb7 service nova] Acquiring lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Cannot resize image /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.objects.instance [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'migration_context' on Instance uuid f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Ensure instance console log exists: /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.objects.instance [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lazy-loading 'flavor' on Instance uuid 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-8cdc114d-57f8-47fc-a190-ae8352b6293f tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.944s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating instance_info_cache with network_info: [{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Releasing lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Instance network_info: |[{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c51324a2-2806-463f-be14-6fb9602456d0 req-ea6d293b-f64b-42db-932a-85d28080abb7 service nova] Acquired lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-c51324a2-2806-463f-be14-6fb9602456d0 req-ea6d293b-f64b-42db-932a-85d28080abb7 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Start _get_guest_xml network_info=[{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T17:08:15Z,direct_url=<?>,disk_format='qcow2',id=49aad436-4f88-4981-b3cd-beb4d0611b7b,min_disk=0,min_ram=0,name='tempest-scenario-img--349332084',owner='775d6e7c342a492f815f2c68c62b291a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T17:08:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': '49aad436-4f88-4981-b3cd-beb4d0611b7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:08:21 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Instance destroyed successfully.
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.objects.instance [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lazy-loading 'resources' on Instance uuid 8cf2697d-18c1-49bd-9f7f-08885d943672 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:08:21 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:08:21 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385776309',display_name='tempest-TestShelveInstance-server-1385776309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385776309',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfS7GX2feKTnfrOaK06MJipk+KIrTAhOCa2C2a/Ye7ImGNYQ+C55l3y85Amnav7T5TbVBED5Ch9B2LsPgo7UEH3fC9jrWXUwMvUgcG2wf3WoW0jsTnUS90XFRIDQUyTsg==',key_name='tempest-TestShelveInstance-1694808483',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:06:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930ca993f8d04c03b073fbe183f064de',ramdisk_id='',reservation_id='r-tc9ckny8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-396312487',owner_user_name='tempest-TestShelveInstance-396312487-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:06:39Z,user_data=None,user_id='7c9f4887220e4691b50538353a898b73',uuid=8cf2697d-18c1-49bd-9f7f-08885d943672,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converting VIF {"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_vif [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b7df7d2-e4, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T17:08:15Z,direct_url=<?>,disk_format='qcow2',id=49aad436-4f88-4981-b3cd-beb4d0611b7b,min_disk=0,min_ram=0,name='tempest-scenario-img--349332084',owner='775d6e7c342a492f815f2c68c62b291a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T17:08:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-228367904',display_name='tempest-TestMinimumBasicScenario-server-228367904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-228367904',id=41,image_ref='49aad436-4f88-4981-b3cd-beb4d0611b7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9WDtZeeLTx+modBMIP61zVQZ5B0mDN2r/grcbY70BtoNCHsupI0OcrJ5/Oi7vVQ1VbKZKaw/ZSrUAQ7FuL5Q3NoS+sKWz0TfWA9ekUquEwVskfqDtCbboFYqgDul2FQw==',key_name='tempest-TestMinimumBasicScenario-186873782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='775d6e7c342a492f815f2c68c62b291a',ramdisk_id='',reservation_id='r-uwh4ohni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='49aad436-4f88-4981-b3cd-beb4d0611b7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-866741703',owner_user_name='tempest-TestMinimumBasicScenario-866741703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:08:19Z,user_data=None,user_id='b14f37927ee848b890ec02b3068251f3',uuid=f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converting VIF {"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:fa:91,bridge_name='br-int',has_traffic_filtering=True,id=888087ef-4c90-4ce4-817f-b1124f30e30d,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888087ef-4c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.objects.instance [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'pci_devices' on Instance uuid f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:08:21 user nova-compute[70659]: INFO os_vif [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4')
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhMcJqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:08:21 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:08:21 user nova-compute[70659]:   <uuid>f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0</uuid>
Jul 25 17:08:21 user nova-compute[70659]:   <name>instance-00000029</name>
Jul 25 17:08:21 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:08:21 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:08:21 user nova-compute[70659]:   <metadata>
Jul 25 17:08:21 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:08:21 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:08:21 user nova-compute[70659]:       <nova:name>tempest-TestMinimumBasicScenario-server-228367904</nova:name>
Jul 25 17:08:21 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:08:21</nova:creationTime>
Jul 25 17:08:21 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:08:21 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:08:21 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:08:21 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:08:21 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:08:21 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:08:21 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:08:21 user nova-compute[70659]:       <nova:owner>
Jul 25 17:08:21 user nova-compute[70659]:         <nova:user uuid="b14f37927ee848b890ec02b3068251f3">tempest-TestMinimumBasicScenario-866741703-project-member</nova:user>
Jul 25 17:08:21 user nova-compute[70659]:         <nova:project uuid="775d6e7c342a492f815f2c68c62b291a">tempest-TestMinimumBasicScenario-866741703</nova:project>
Jul 25 17:08:21 user nova-compute[70659]:       </nova:owner>
Jul 25 17:08:21 user nova-compute[70659]:       <nova:root type="image" uuid="49aad436-4f88-4981-b3cd-beb4d0611b7b"/>
Jul 25 17:08:21 user nova-compute[70659]:       <nova:ports>
Jul 25 17:08:21 user nova-compute[70659]:         <nova:port uuid="888087ef-4c90-4ce4-817f-b1124f30e30d">
Jul 25 17:08:21 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 17:08:21 user nova-compute[70659]:         </nova:port>
Jul 25 17:08:21 user nova-compute[70659]:       </nova:ports>
Jul 25 17:08:21 user nova-compute[70659]:     </nova:instance>
Jul 25 17:08:21 user nova-compute[70659]:   </metadata>
Jul 25 17:08:21 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:08:21 user nova-compute[70659]:     <system>
Jul 25 17:08:21 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:08:21 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:08:21 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:08:21 user nova-compute[70659]:       <entry name="serial">f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0</entry>
Jul 25 17:08:21 user nova-compute[70659]:       <entry name="uuid">f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0</entry>
Jul 25 17:08:21 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:08:21 user nova-compute[70659]:     </system>
Jul 25 17:08:21 user nova-compute[70659]:   </sysinfo>
Jul 25 17:08:21 user nova-compute[70659]:   <os>
Jul 25 17:08:21 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:08:21 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:08:21 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:08:21 user nova-compute[70659]:   </os>
Jul 25 17:08:21 user nova-compute[70659]:   <features>
Jul 25 17:08:21 user nova-compute[70659]:     <acpi/>
Jul 25 17:08:21 user nova-compute[70659]:     <apic/>
Jul 25 17:08:21 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:08:21 user nova-compute[70659]:   </features>
Jul 25 17:08:21 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:08:21 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:08:21 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:08:21 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:08:21 user nova-compute[70659]:   </clock>
Jul 25 17:08:21 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:08:21 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:08:21 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:08:21 user nova-compute[70659]:   </cpu>
Jul 25 17:08:21 user nova-compute[70659]:   <devices>
Jul 25 17:08:21 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:08:21 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:08:21 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk"/>
Jul 25 17:08:21 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:08:21 user nova-compute[70659]:     </disk>
Jul 25 17:08:21 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:08:21 user nova-compute[70659]:       <mac address="fa:16:3e:fc:fa:91"/>
Jul 25 17:08:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:08:21 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:08:21 user nova-compute[70659]:       <target dev="tap888087ef-4c"/>
Jul 25 17:08:21 user nova-compute[70659]:     </interface>
Jul 25 17:08:21 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:08:21 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/console.log" append="off"/>
Jul 25 17:08:21 user nova-compute[70659]:     </serial>
Jul 25 17:08:21 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:08:21 user nova-compute[70659]:     <video>
Jul 25 17:08:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:08:21 user nova-compute[70659]:     </video>
Jul 25 17:08:21 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:08:21 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:08:21 user nova-compute[70659]:     </rng>
Jul 25 17:08:21 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:08:21 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:08:21 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:08:21 user nova-compute[70659]:     </memballoon>
Jul 25 17:08:21 user nova-compute[70659]:   </devices>
Jul 25 17:08:21 user nova-compute[70659]: </domain>
Jul 25 17:08:21 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-228367904',display_name='tempest-TestMinimumBasicScenario-server-228367904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-228367904',id=41,image_ref='49aad436-4f88-4981-b3cd-beb4d0611b7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9WDtZeeLTx+modBMIP61zVQZ5B0mDN2r/grcbY70BtoNCHsupI0OcrJ5/Oi7vVQ1VbKZKaw/ZSrUAQ7FuL5Q3NoS+sKWz0TfWA9ekUquEwVskfqDtCbboFYqgDul2FQw==',key_name='tempest-TestMinimumBasicScenario-186873782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='775d6e7c342a492f815f2c68c62b291a',ramdisk_id='',reservation_id='r-uwh4ohni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='49aad436-4f88-4981-b3cd-beb4d0611b7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-866741703',owner_user_name='tempest-TestMinimumBasicScenario-866741703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:08:19Z,user_data=None,user_id='b14f37927ee848b890ec02b3068251f3',uuid=f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converting VIF {"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:fa:91,bridge_name='br-int',has_traffic_filtering=True,id=888087ef-4c90-4ce4-817f-b1124f30e30d,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888087ef-4c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_vif [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:fa:91,bridge_name='br-int',has_traffic_filtering=True,id=888087ef-4c90-4ce4-817f-b1124f30e30d,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888087ef-4c') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap888087ef-4c, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap888087ef-4c, col_values=(('external_ids', {'iface-id': '888087ef-4c90-4ce4-817f-b1124f30e30d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:fa:91', 'vm-uuid': 'f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f724b2-8f17-4de6-a42d-13412efc2264]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:21 user nova-compute[70659]: INFO os_vif [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:fa:91,bridge_name='br-int',has_traffic_filtering=True,id=888087ef-4c90-4ce4-817f-b1124f30e30d,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888087ef-4c')
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c5646e-7239-4cb9-abdc-96aa8269cdc2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:21 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:21 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:21 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:21 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:08:21 user nova-compute[70659]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:08:21 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:08:21 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:08:21 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30498af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'): ({'sdd'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Removing single pathed devices sdd {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b6c56f-3de7-4d27-8d0a-ffc5b390e0eb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No VIF found with MAC fa:16:3e:fc:fa:91, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef12dff-8729-4778-b180-47f24faec952]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Flushing IO for device /dev/sdd {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f54a3a2-fabd-41db-9581-65e732242ab7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef27db11-3bf9-42f5-a4fa-64a03a249afb]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2223b863-905e-439d-b267-9eb9abb274b1]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[204cc875-1881-47be-8dd9-c8670fd7f849]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260]
Jul 25 17:08:22 user nova-compute[70659]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260] successful.
Jul 25 17:08:22 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[80328dd2-22a3-4171-9a83-ab445fed5c40]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] <== disconnect_volume: return (311ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:08:22 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Deleting instance files /opt/stack/data/nova/instances/8cf2697d-18c1-49bd-9f7f-08885d943672_del
Jul 25 17:08:22 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Deletion of /opt/stack/data/nova/instances/8cf2697d-18c1-49bd-9f7f-08885d943672_del complete
Jul 25 17:08:22 user nova-compute[70659]: DEBUG nova.network.neutron [req-c51324a2-2806-463f-be14-6fb9602456d0 req-ea6d293b-f64b-42db-932a-85d28080abb7 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updated VIF entry in instance network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG nova.network.neutron [req-c51324a2-2806-463f-be14-6fb9602456d0 req-ea6d293b-f64b-42db-932a-85d28080abb7 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating instance_info_cache with network_info: [{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c51324a2-2806-463f-be14-6fb9602456d0 req-ea6d293b-f64b-42db-932a-85d28080abb7 service nova] Releasing lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:08:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:23 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Deleted allocations for instance 8cf2697d-18c1-49bd-9f7f-08885d943672
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.objects.instance [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cf2697d-18c1-49bd-9f7f-08885d943672 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-45743f96-2a81-44d0-99b2-a1367c12365b req-7eecd666-e25f-4d97-bade-3b86fd33c007 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-45743f96-2a81-44d0-99b2-a1367c12365b req-7eecd666-e25f-4d97-bade-3b86fd33c007 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing instance network info cache due to event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-45743f96-2a81-44d0-99b2-a1367c12365b req-7eecd666-e25f-4d97-bade-3b86fd33c007 service nova] Acquiring lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-45743f96-2a81-44d0-99b2-a1367c12365b req-7eecd666-e25f-4d97-bade-3b86fd33c007 service nova] Acquired lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-45743f96-2a81-44d0-99b2-a1367c12365b req-7eecd666-e25f-4d97-bade-3b86fd33c007 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-71987a70-1587-441b-a513-7750b427913c req-8933c357-78d6-407d-b6f8-faaadfac30dd service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-71987a70-1587-441b-a513-7750b427913c req-8933c357-78d6-407d-b6f8-faaadfac30dd service nova] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-71987a70-1587-441b-a513-7750b427913c req-8933c357-78d6-407d-b6f8-faaadfac30dd service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-71987a70-1587-441b-a513-7750b427913c req-8933c357-78d6-407d-b6f8-faaadfac30dd service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-71987a70-1587-441b-a513-7750b427913c req-8933c357-78d6-407d-b6f8-faaadfac30dd service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] No waiting events found dispatching network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:23 user nova-compute[70659]: WARNING nova.compute.manager [req-71987a70-1587-441b-a513-7750b427913c req-8933c357-78d6-407d-b6f8-faaadfac30dd service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received unexpected event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d for instance with vm_state building and task_state spawning.
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-41d226a1-e064-49ac-a2a7-5373128f8d69 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.206s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-45743f96-2a81-44d0-99b2-a1367c12365b req-7eecd666-e25f-4d97-bade-3b86fd33c007 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updated VIF entry in instance network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-45743f96-2a81-44d0-99b2-a1367c12365b req-7eecd666-e25f-4d97-bade-3b86fd33c007 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating instance_info_cache with network_info: [{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": null, "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-45743f96-2a81-44d0-99b2-a1367c12365b req-7eecd666-e25f-4d97-bade-3b86fd33c007 service nova] Releasing lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304905.408209, f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:08:25 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] VM Resumed (Lifecycle Event)
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:08:25 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Instance spawned successfully.
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:08:25 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304905.4095607, f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:08:25 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] VM Started (Lifecycle Event)
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:08:25 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:08:25 user nova-compute[70659]: INFO nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Took 6.16 seconds to spawn the instance on the hypervisor.
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-c91d3159-7867-4df8-99a4-5da88d180c30 req-c2589fa4-4b4b-4f5f-87b6-e6bf2f5b2f1b service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c91d3159-7867-4df8-99a4-5da88d180c30 req-c2589fa4-4b4b-4f5f-87b6-e6bf2f5b2f1b service nova] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c91d3159-7867-4df8-99a4-5da88d180c30 req-c2589fa4-4b4b-4f5f-87b6-e6bf2f5b2f1b service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c91d3159-7867-4df8-99a4-5da88d180c30 req-c2589fa4-4b4b-4f5f-87b6-e6bf2f5b2f1b service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-c91d3159-7867-4df8-99a4-5da88d180c30 req-c2589fa4-4b4b-4f5f-87b6-e6bf2f5b2f1b service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] No waiting events found dispatching network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:08:25 user nova-compute[70659]: WARNING nova.compute.manager [req-c91d3159-7867-4df8-99a4-5da88d180c30 req-c2589fa4-4b4b-4f5f-87b6-e6bf2f5b2f1b service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received unexpected event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d for instance with vm_state active and task_state None.
Jul 25 17:08:25 user nova-compute[70659]: INFO nova.compute.manager [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Took 7.17 seconds to build instance.
Jul 25 17:08:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-20e24b9e-4c87-4eed-a4d7-a69fe3a0b96e tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.273s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:08:26 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304891.3443213, 856974f4-fd81-4d22-a316-5e08c36e35d6 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:08:26 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] VM Stopped (Lifecycle Event)
Jul 25 17:08:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6282d7a2-09ab-432e-9808-116d77a9df4b None None] [instance: 856974f4-fd81-4d22-a316-5e08c36e35d6] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:08:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:34 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304899.565885, 8cf2697d-18c1-49bd-9f7f-08885d943672 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:08:34 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] VM Stopped (Lifecycle Event)
Jul 25 17:08:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7283903e-afbe-4d26-9697-a47e8f9f8666 None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:08:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:08:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:08:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:08:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:08:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:57 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:08:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:08:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:00 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "e006724d-e45a-405f-9084-544925aaa8ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "e006724d-e45a-405f-9084-544925aaa8ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "e006724d-e45a-405f-9084-544925aaa8ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:01 user nova-compute[70659]: INFO nova.compute.manager [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Terminating instance
Jul 25 17:09:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-c755f320-49ed-40d9-ada3-fc5f067823a4 req-9a4fea12-ea0f-4784-94f8-42c54d6b60c5 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received event network-vif-unplugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c755f320-49ed-40d9-ada3-fc5f067823a4 req-9a4fea12-ea0f-4784-94f8-42c54d6b60c5 service nova] Acquiring lock "e006724d-e45a-405f-9084-544925aaa8ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c755f320-49ed-40d9-ada3-fc5f067823a4 req-9a4fea12-ea0f-4784-94f8-42c54d6b60c5 service nova] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c755f320-49ed-40d9-ada3-fc5f067823a4 req-9a4fea12-ea0f-4784-94f8-42c54d6b60c5 service nova] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-c755f320-49ed-40d9-ada3-fc5f067823a4 req-9a4fea12-ea0f-4784-94f8-42c54d6b60c5 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] No waiting events found dispatching network-vif-unplugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-c755f320-49ed-40d9-ada3-fc5f067823a4 req-9a4fea12-ea0f-4784-94f8-42c54d6b60c5 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received event network-vif-unplugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:01 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Instance destroyed successfully.
Jul 25 17:09:01 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'resources' on Instance uuid e006724d-e45a-405f-9084-544925aaa8ad {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-230443236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-230443236',id=31,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-q70p52ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:01:36Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=e006724d-e45a-405f-9084-544925aaa8ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "address": "fa:16:3e:82:0c:b8", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a6b1a1-72", "ovs_interfaceid": "a9a6b1a1-7294-4877-97fa-152f2cb7d2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:0c:b8,bridge_name='br-int',has_traffic_filtering=True,id=a9a6b1a1-7294-4877-97fa-152f2cb7d2d3,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a6b1a1-72') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG os_vif [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:0c:b8,bridge_name='br-int',has_traffic_filtering=True,id=a9a6b1a1-7294-4877-97fa-152f2cb7d2d3,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a6b1a1-72') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9a6b1a1-72, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:01 user nova-compute[70659]: INFO os_vif [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:0c:b8,bridge_name='br-int',has_traffic_filtering=True,id=a9a6b1a1-7294-4877-97fa-152f2cb7d2d3,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a6b1a1-72')
Jul 25 17:09:01 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Deleting instance files /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad_del
Jul 25 17:09:01 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Deletion of /opt/stack/data/nova/instances/e006724d-e45a-405f-9084-544925aaa8ad_del complete
Jul 25 17:09:02 user nova-compute[70659]: INFO nova.compute.manager [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Took 0.64 seconds to destroy the instance on the hypervisor.
Jul 25 17:09:02 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:09:02 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:09:02 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: e006724d-e45a-405f-9084-544925aaa8ad] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:09:02 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:09:02 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Took 0.53 seconds to deallocate network for instance.
Jul 25 17:09:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:02 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:09:02 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:09:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:02 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Deleted allocations for instance e006724d-e45a-405f-9084-544925aaa8ad
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b94feef2-d849-472b-a45c-392c978385a8 tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "e006724d-e45a-405f-9084-544925aaa8ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.599s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-93d058ee-0ced-4412-b5e8-9f5ce4cabe80 req-8bb5509d-e484-486b-b5b8-9bd2d99b40b0 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received event network-vif-plugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-93d058ee-0ced-4412-b5e8-9f5ce4cabe80 req-8bb5509d-e484-486b-b5b8-9bd2d99b40b0 service nova] Acquiring lock "e006724d-e45a-405f-9084-544925aaa8ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-93d058ee-0ced-4412-b5e8-9f5ce4cabe80 req-8bb5509d-e484-486b-b5b8-9bd2d99b40b0 service nova] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-93d058ee-0ced-4412-b5e8-9f5ce4cabe80 req-8bb5509d-e484-486b-b5b8-9bd2d99b40b0 service nova] Lock "e006724d-e45a-405f-9084-544925aaa8ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-93d058ee-0ced-4412-b5e8-9f5ce4cabe80 req-8bb5509d-e484-486b-b5b8-9bd2d99b40b0 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] No waiting events found dispatching network-vif-plugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:03 user nova-compute[70659]: WARNING nova.compute.manager [req-93d058ee-0ced-4412-b5e8-9f5ce4cabe80 req-8bb5509d-e484-486b-b5b8-9bd2d99b40b0 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received unexpected event network-vif-plugged-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 for instance with vm_state deleted and task_state None.
Jul 25 17:09:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-93d058ee-0ced-4412-b5e8-9f5ce4cabe80 req-8bb5509d-e484-486b-b5b8-9bd2d99b40b0 service nova] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Received event network-vif-deleted-a9a6b1a1-7294-4877-97fa-152f2cb7d2d3 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:03 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:04 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:09:05 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:09:05 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=7910MB free_disk=25.086978912353516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 73980900-2093-4338-8460-d91df2e2709d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 940f2d84-8561-4345-a291-819dc67abba8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fdea0673-35e9-4e1f-be7c-dc942986dc89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:09:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:06 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:09 user nova-compute[70659]: INFO nova.compute.manager [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Detaching volume ed943080-6bc5-44b9-9eeb-8f6782420ed2
Jul 25 17:09:09 user nova-compute[70659]: INFO nova.virt.block_device [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Attempting to driver detach volume ed943080-6bc5-44b9-9eeb-8f6782420ed2 from mountpoint /dev/vdb
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Attempting to detach device vdb from instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:09:09 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:09:09 user nova-compute[70659]:   <source dev="/dev/sdf"/>
Jul 25 17:09:09 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:09:09 user nova-compute[70659]:   <serial>ed943080-6bc5-44b9-9eeb-8f6782420ed2</serial>
Jul 25 17:09:09 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:09:09 user nova-compute[70659]: </disk>
Jul 25 17:09:09 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:09:09 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Successfully detached device vdb from instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee from the persistent domain config.
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:09:09 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:09:09 user nova-compute[70659]:   <source dev="/dev/sdf"/>
Jul 25 17:09:09 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:09:09 user nova-compute[70659]:   <serial>ed943080-6bc5-44b9-9eeb-8f6782420ed2</serial>
Jul 25 17:09:09 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:09:09 user nova-compute[70659]: </disk>
Jul 25 17:09:09 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid fc09d930-4a75-490b-a86a-08fe432d778c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304949.6457736, 5eb4c44f-9955-4203-a3e6-8352cd9045ee => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:09:09 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Successfully detached device vdb from instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee from the live domain config.
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gracDmxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:09:09 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20f9533-a231-4ca6-9d05-353ee0ee18f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2d383b-0130-47a1-84ea-f7e4252b8435]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:09 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:09 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:09:09 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:09 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:09 user nova-compute[70659]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 (non-flash)
Jul 25 17:09:09 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd307283a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2'): ({'sdf'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Removing single pathed devices sdf {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[92641a84-56a4-486b-8004-1850e95128ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updating instance_info_cache with network_info: [{"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f632d6-05cc-49e6-b43b-c9fb52a8e708]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Flushing IO for device /dev/sdf {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-fc09d930-4a75-490b-a86a-08fe432d778c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383c5fd-bd85-4cc0-8c6c-a2e9051f6c97]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1944d949-ee73-49a4-8f60-eb97145c2853]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] SCSI volumes sdf have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acedce6-0a1f-4543-8aa1-bdfd4a074d43]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc001376-4379-47e2-8901-93f156082fb1]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2, portal: 172.16.0.220,3260]
Jul 25 17:09:09 user nova-compute[70659]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2, portal: 172.16.0.220,3260] successful.
Jul 25 17:09:09 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed943080-6bc5-44b9-9eeb-8f6782420ed2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77d805-f48c-4bfb-a869-d75567090f7d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] <== disconnect_volume: return (269ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:09:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:09:10 user nova-compute[70659]: DEBUG nova.objects.instance [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lazy-loading 'flavor' on Instance uuid 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-732c9297-1f4c-4f46-be64-0e7234de0af7 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.530s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:16 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304941.958101, e006724d-e45a-405f-9084-544925aaa8ad => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:09:16 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: e006724d-e45a-405f-9084-544925aaa8ad] VM Stopped (Lifecycle Event)
Jul 25 17:09:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-48182b39-7810-4cc7-a45b-ef51904a313d None None] [instance: e006724d-e45a-405f-9084-544925aaa8ad] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:09:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:09:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-9977e1e6-fe7b-449d-b1ab-b28a99d5f8da req-d1510662-8e13-468a-8feb-a636f218f498 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-changed-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-9977e1e6-fe7b-449d-b1ab-b28a99d5f8da req-d1510662-8e13-468a-8feb-a636f218f498 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Refreshing instance network info cache due to event network-changed-2522dddf-d653-4f79-9db4-4785f9566253. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:09:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9977e1e6-fe7b-449d-b1ab-b28a99d5f8da req-d1510662-8e13-468a-8feb-a636f218f498 service nova] Acquiring lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:09:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9977e1e6-fe7b-449d-b1ab-b28a99d5f8da req-d1510662-8e13-468a-8feb-a636f218f498 service nova] Acquired lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:09:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-9977e1e6-fe7b-449d-b1ab-b28a99d5f8da req-d1510662-8e13-468a-8feb-a636f218f498 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Refreshing network info cache for port 2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:09:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-9977e1e6-fe7b-449d-b1ab-b28a99d5f8da req-d1510662-8e13-468a-8feb-a636f218f498 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updated VIF entry in instance network info cache for port 2522dddf-d653-4f79-9db4-4785f9566253. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:09:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-9977e1e6-fe7b-449d-b1ab-b28a99d5f8da req-d1510662-8e13-468a-8feb-a636f218f498 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating instance_info_cache with network_info: [{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:09:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9977e1e6-fe7b-449d-b1ab-b28a99d5f8da req-d1510662-8e13-468a-8feb-a636f218f498 service nova] Releasing lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Stashing vm_state: active {{(pid=70659) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'pci_requests' on Instance uuid 940f2d84-8561-4345-a291-819dc67abba8 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:09:26 user nova-compute[70659]: INFO nova.compute.claims [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Claim successful on node user
Jul 25 17:09:26 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'resources' on Instance uuid 940f2d84-8561-4345-a291-819dc67abba8 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'pci_devices' on Instance uuid 940f2d84-8561-4345-a291-819dc67abba8 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:26 user nova-compute[70659]: INFO nova.compute.resource_tracker [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating resource usage from migration b921e653-b786-4278-946f-646d615199ac
Jul 25 17:09:26 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:09:26 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:09:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:09:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.379s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:27 user nova-compute[70659]: INFO nova.compute.manager [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Migrating
Jul 25 17:09:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:09:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquired lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:09:27 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:09:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-0e1c7694-dec6-40b7-831e-627e8f21c7b3 req-9210c81c-6983-49b9-83ae-ff476563d758 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-changed-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-0e1c7694-dec6-40b7-831e-627e8f21c7b3 req-9210c81c-6983-49b9-83ae-ff476563d758 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Refreshing instance network info cache due to event network-changed-182ef6f0-865b-4e16-89c8-9b57ace1d272. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:09:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0e1c7694-dec6-40b7-831e-627e8f21c7b3 req-9210c81c-6983-49b9-83ae-ff476563d758 service nova] Acquiring lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating instance_info_cache with network_info: [{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Releasing lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0e1c7694-dec6-40b7-831e-627e8f21c7b3 req-9210c81c-6983-49b9-83ae-ff476563d758 service nova] Acquired lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-0e1c7694-dec6-40b7-831e-627e8f21c7b3 req-9210c81c-6983-49b9-83ae-ff476563d758 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Refreshing network info cache for port 182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Starting migrate_disk_and_power_off {{(pid=70659) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-8f764596-ac8a-4692-836d-74659ac7ef0f req-38ca03a6-bf4f-453d-8d87-55e8a4d279cb service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-unplugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8f764596-ac8a-4692-836d-74659ac7ef0f req-38ca03a6-bf4f-453d-8d87-55e8a4d279cb service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8f764596-ac8a-4692-836d-74659ac7ef0f req-38ca03a6-bf4f-453d-8d87-55e8a4d279cb service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8f764596-ac8a-4692-836d-74659ac7ef0f req-38ca03a6-bf4f-453d-8d87-55e8a4d279cb service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-8f764596-ac8a-4692-836d-74659ac7ef0f req-38ca03a6-bf4f-453d-8d87-55e8a4d279cb service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-unplugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:28 user nova-compute[70659]: WARNING nova.compute.manager [req-8f764596-ac8a-4692-836d-74659ac7ef0f req-38ca03a6-bf4f-453d-8d87-55e8a4d279cb service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-unplugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state active and task_state resize_migrating.
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-0e1c7694-dec6-40b7-831e-627e8f21c7b3 req-9210c81c-6983-49b9-83ae-ff476563d758 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updated VIF entry in instance network info cache for port 182ef6f0-865b-4e16-89c8-9b57ace1d272. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-0e1c7694-dec6-40b7-831e-627e8f21c7b3 req-9210c81c-6983-49b9-83ae-ff476563d758 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating instance_info_cache with network_info: [{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0e1c7694-dec6-40b7-831e-627e8f21c7b3 req-9210c81c-6983-49b9-83ae-ff476563d758 service nova] Releasing lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Instance destroyed successfully.
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-997832181',display_name='tempest-ServerActionsTestOtherA-server-997832181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-997832181',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:07:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-a151piun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=940f2d84-8561-4345-a291-819dc67abba8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-901800358-network", "vif_mac": "fa:16:3e:80:67:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-901800358-network", "vif_mac": "fa:16:3e:80:67:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG os_vif [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap182ef6f0-86, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:09:28 user nova-compute[70659]: INFO os_vif [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86')
Jul 25 17:09:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdMEbPGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:09:29 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[74efc8cd-f617-4824-8bcc-a98f55228ee9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e194a7f5-4cd9-48b7-afaf-8fb204251f00]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:29 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:29 user nova-compute[70659]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd281fb0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'): ({'sde'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Removing single pathed devices sde {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3edb72a-8fcf-4737-b279-b426b8791adc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd491fe8-ff72-4583-9b22-800d4895ab28]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flushing IO for device /dev/sde {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cb386b-d863-4127-a147-48636088309b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2de010f-3956-4268-b63b-4c9d98058f42]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] SCSI volumes sde have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23332376161333334', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f5c6f015', '/dev/disk/by-id/scsi-1SCST_BIOf5c6f015-327aa3346fdc2afa') {{(pid=81811) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3aea91-5134-4689-ab89-bab390201dbb]: (4, None) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7015460-b8dc-4f08-9a93-8924d26fc612]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b3f354-ad2d-49fe-9495-f1eb71e13393]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260]
Jul 25 17:09:29 user nova-compute[70659]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260] successful.
Jul 25 17:09:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c809f618-1e9c-4dcf-a400-8ad8197a8946]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== disconnect_volume: return (318ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:09:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Port 182ef6f0-865b-4e16-89c8-9b57ace1d272 binding to destination host user is already ACTIVE {{(pid=70659) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:30 user nova-compute[70659]: WARNING nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state active and task_state resize_migrated.
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:30 user nova-compute[70659]: WARNING nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state active and task_state resize_migrated.
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:30 user nova-compute[70659]: WARNING nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state active and task_state resize_migrated.
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-unplugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-unplugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:30 user nova-compute[70659]: WARNING nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-unplugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state active and task_state resize_migrated.
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:30 user nova-compute[70659]: WARNING nova.compute.manager [req-e56316cf-79d6-42a1-97ac-ace0026d8eaf req-4efb0609-5c57-4959-b33f-c5a88702d2f4 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state active and task_state resize_migrated.
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquired lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:09:30 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG nova.network.neutron [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating instance_info_cache with network_info: [{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Releasing lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG os_brick.utils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a61992-1979-4314-aea1-4216033bbc0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59489da-6fbd-47a5-8b40-e3998b77a752]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2e2c57-241d-4172-8f6b-55019d094def]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae701c8-b78b-4f4c-968e-8ddbadf1e012]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:09:31 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:09:31 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c41fb9-8f6a-4ca9-90f5-13cffcbf19fe]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:09:31 user nova-compute[70659]: DEBUG os_brick.utils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:09:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-410227d0-a52f-4541-8500-ac17f310ca98 req-9693cc63-581e-4dc8-bae2-9ce74dee3e93 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received event network-changed-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-410227d0-a52f-4541-8500-ac17f310ca98 req-9693cc63-581e-4dc8-bae2-9ce74dee3e93 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Refreshing instance network info cache due to event network-changed-b63b7573-ab84-4a4a-97bb-7321bc01cb75. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:09:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-410227d0-a52f-4541-8500-ac17f310ca98 req-9693cc63-581e-4dc8-bae2-9ce74dee3e93 service nova] Acquiring lock "refresh_cache-fdea0673-35e9-4e1f-be7c-dc942986dc89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:09:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-410227d0-a52f-4541-8500-ac17f310ca98 req-9693cc63-581e-4dc8-bae2-9ce74dee3e93 service nova] Acquired lock "refresh_cache-fdea0673-35e9-4e1f-be7c-dc942986dc89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:09:32 user nova-compute[70659]: DEBUG nova.network.neutron [req-410227d0-a52f-4541-8500-ac17f310ca98 req-9693cc63-581e-4dc8-bae2-9ce74dee3e93 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Refreshing network info cache for port b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:09:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-410227d0-a52f-4541-8500-ac17f310ca98 req-9693cc63-581e-4dc8-bae2-9ce74dee3e93 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Updated VIF entry in instance network info cache for port b63b7573-ab84-4a4a-97bb-7321bc01cb75. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:09:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-410227d0-a52f-4541-8500-ac17f310ca98 req-9693cc63-581e-4dc8-bae2-9ce74dee3e93 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Updating instance_info_cache with network_info: [{"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:09:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-410227d0-a52f-4541-8500-ac17f310ca98 req-9693cc63-581e-4dc8-bae2-9ce74dee3e93 service nova] Releasing lock "refresh_cache-fdea0673-35e9-4e1f-be7c-dc942986dc89" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:09:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG nova.objects.instance [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'flavor' on Instance uuid fdea0673-35e9-4e1f-be7c-dc942986dc89 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:35 user nova-compute[70659]: INFO nova.compute.manager [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Attaching volume d3ad77b7-38b5-4ad9-8508-54999251c7c2 to /dev/vdb
Jul 25 17:09:35 user nova-compute[70659]: DEBUG os_brick.utils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[671c5c58-b67a-462b-86a7-9509f70c549b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b26b05b-b314-493c-b3a4-984ab55d21b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd1d5cd-743c-48b2-936a-5ccadb9dbb8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[37368fd0-a146-4f4e-85e9-438119a129b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:09:35 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:09:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f7f804-ef7e-4cc3-9ddf-f96d9e62055a]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG os_brick.utils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:09:35 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Updating existing volume attachment record: 60571c2b-a809-437c-a009-8b78e133ea9e {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Starting finish_migration {{(pid=70659) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Instance directory exists: not creating {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 17:09:37 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Creating image(s)
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Ensure instance console log exists: /opt/stack/data/nova/instances/940f2d84-8561-4345-a291-819dc67abba8/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Start _get_guest_xml network_info=[{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-901800358-network", "vif_mac": "fa:16:3e:80:67:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'aabc4d90-66d3-4ace-b35f-ef364be2c270', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdMEbPGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '940f2d84-8561-4345-a291-819dc67abba8', 'attached_at': '2023-07-25T17:09:38.000000', 'detached_at': '', 'volume_id': 'dad3d12e-5a7f-4a92-8ab9-8413cbee0a98', 'serial': 'dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:09:37 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:09:37 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'vcpu_model' on Instance uuid 940f2d84-8561-4345-a291-819dc67abba8 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdMEbPGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:09:37 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:09:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:09:37 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:09:38 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:09:38 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a94147-51d6-4fd4-975a-26fb66e6da67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:09:38 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f9e73-f0ab-403e-a686-5c21bac9f9ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98] added
Jul 25 17:09:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b75a5a-08d4-4275-8d99-476717633437]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e1dcc-9e67-4d36-a8a8-be3d39d25bc3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdMEbPGq {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdMEbPGq" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f06b96-e4cd-4b3e-9eaf-56dd8356be48]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KdMEbPGq'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb358e6-f3fd-49f2-9d77-48db62b02331]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc9257-6629-4134-9106-fe91a0984dfe]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[52875a32-e679-455c-81c7-9a64b1271386]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260]
Jul 25 17:09:38 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260] successful.
Jul 25 17:09:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[20692857-1b35-4cf2-97b9-c06d3da93d2c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e54e780-3533-40f5-8a90-c2c1592df27d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:38 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:38 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:38 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb285acc-30b2-4fb0-bc4a-1e321784cf6e]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdMEbPGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:09:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23332376161333334', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332376161333334', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-997832181',display_name='tempest-ServerActionsTestOtherA-server-997832181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-997832181',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:07:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-a151piun',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=940f2d84-8561-4345-a291-819dc67abba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-901800358-network", "vif_mac": "fa:16:3e:80:67:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-901800358-network", "vif_mac": "fa:16:3e:80:67:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:09:39 user nova-compute[70659]:   <uuid>940f2d84-8561-4345-a291-819dc67abba8</uuid>
Jul 25 17:09:39 user nova-compute[70659]:   <name>instance-00000027</name>
Jul 25 17:09:39 user nova-compute[70659]:   <memory>2097152</memory>
Jul 25 17:09:39 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:09:39 user nova-compute[70659]:   <metadata>
Jul 25 17:09:39 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:09:39 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:09:39 user nova-compute[70659]:       <nova:name>tempest-ServerActionsTestOtherA-server-997832181</nova:name>
Jul 25 17:09:39 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:09:37</nova:creationTime>
Jul 25 17:09:39 user nova-compute[70659]:       <nova:flavor name="m1.small">
Jul 25 17:09:39 user nova-compute[70659]:         <nova:memory>2048</nova:memory>
Jul 25 17:09:39 user nova-compute[70659]:         <nova:disk>20</nova:disk>
Jul 25 17:09:39 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:09:39 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:09:39 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:09:39 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:09:39 user nova-compute[70659]:       <nova:owner>
Jul 25 17:09:39 user nova-compute[70659]:         <nova:user uuid="4f29db3ae5934862b72e71e6863b46a6">tempest-ServerActionsTestOtherA-1965201562-project-member</nova:user>
Jul 25 17:09:39 user nova-compute[70659]:         <nova:project uuid="77a3bf6c11a04274b5059bd9dd6be00e">tempest-ServerActionsTestOtherA-1965201562</nova:project>
Jul 25 17:09:39 user nova-compute[70659]:       </nova:owner>
Jul 25 17:09:39 user nova-compute[70659]:       <nova:ports>
Jul 25 17:09:39 user nova-compute[70659]:         <nova:port uuid="182ef6f0-865b-4e16-89c8-9b57ace1d272">
Jul 25 17:09:39 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 17:09:39 user nova-compute[70659]:         </nova:port>
Jul 25 17:09:39 user nova-compute[70659]:       </nova:ports>
Jul 25 17:09:39 user nova-compute[70659]:     </nova:instance>
Jul 25 17:09:39 user nova-compute[70659]:   </metadata>
Jul 25 17:09:39 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:09:39 user nova-compute[70659]:     <system>
Jul 25 17:09:39 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:09:39 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:09:39 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:09:39 user nova-compute[70659]:       <entry name="serial">940f2d84-8561-4345-a291-819dc67abba8</entry>
Jul 25 17:09:39 user nova-compute[70659]:       <entry name="uuid">940f2d84-8561-4345-a291-819dc67abba8</entry>
Jul 25 17:09:39 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:09:39 user nova-compute[70659]:     </system>
Jul 25 17:09:39 user nova-compute[70659]:   </sysinfo>
Jul 25 17:09:39 user nova-compute[70659]:   <os>
Jul 25 17:09:39 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:09:39 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:09:39 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:09:39 user nova-compute[70659]:   </os>
Jul 25 17:09:39 user nova-compute[70659]:   <features>
Jul 25 17:09:39 user nova-compute[70659]:     <acpi/>
Jul 25 17:09:39 user nova-compute[70659]:     <apic/>
Jul 25 17:09:39 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:09:39 user nova-compute[70659]:   </features>
Jul 25 17:09:39 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:09:39 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:09:39 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:09:39 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:09:39 user nova-compute[70659]:   </clock>
Jul 25 17:09:39 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:09:39 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:09:39 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:09:39 user nova-compute[70659]:   </cpu>
Jul 25 17:09:39 user nova-compute[70659]:   <devices>
Jul 25 17:09:39 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:09:39 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:09:39 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 17:09:39 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:09:39 user nova-compute[70659]:       <serial>dad3d12e-5a7f-4a92-8ab9-8413cbee0a98</serial>
Jul 25 17:09:39 user nova-compute[70659]:     </disk>
Jul 25 17:09:39 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:09:39 user nova-compute[70659]:       <mac address="fa:16:3e:80:67:ef"/>
Jul 25 17:09:39 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:09:39 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:09:39 user nova-compute[70659]:       <target dev="tap182ef6f0-86"/>
Jul 25 17:09:39 user nova-compute[70659]:     </interface>
Jul 25 17:09:39 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:09:39 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/940f2d84-8561-4345-a291-819dc67abba8/console.log" append="off"/>
Jul 25 17:09:39 user nova-compute[70659]:     </serial>
Jul 25 17:09:39 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:09:39 user nova-compute[70659]:     <video>
Jul 25 17:09:39 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:09:39 user nova-compute[70659]:     </video>
Jul 25 17:09:39 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:09:39 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:09:39 user nova-compute[70659]:     </rng>
Jul 25 17:09:39 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:09:39 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:09:39 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:09:39 user nova-compute[70659]:     </memballoon>
Jul 25 17:09:39 user nova-compute[70659]:   </devices>
Jul 25 17:09:39 user nova-compute[70659]: </domain>
Jul 25 17:09:39 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-997832181',display_name='tempest-ServerActionsTestOtherA-server-997832181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-997832181',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:07:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-a151piun',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=940f2d84-8561-4345-a291-819dc67abba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-901800358-network", "vif_mac": "fa:16:3e:80:67:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-901800358-network", "vif_mac": "fa:16:3e:80:67:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG os_vif [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap182ef6f0-86, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap182ef6f0-86, col_values=(('external_ids', {'iface-id': '182ef6f0-865b-4e16-89c8-9b57ace1d272', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:67:ef', 'vm-uuid': '940f2d84-8561-4345-a291-819dc67abba8'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:39 user nova-compute[70659]: INFO os_vif [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86')
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:09:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] No VIF found with MAC fa:16:3e:80:67:ef, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:09:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-0a1a6ae9-720b-4bfc-b9d1-99cdfc4ca9c6 req-12e20945-639d-4a71-8eed-3c0cb778cf0d service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0a1a6ae9-720b-4bfc-b9d1-99cdfc4ca9c6 req-12e20945-639d-4a71-8eed-3c0cb778cf0d service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0a1a6ae9-720b-4bfc-b9d1-99cdfc4ca9c6 req-12e20945-639d-4a71-8eed-3c0cb778cf0d service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0a1a6ae9-720b-4bfc-b9d1-99cdfc4ca9c6 req-12e20945-639d-4a71-8eed-3c0cb778cf0d service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-0a1a6ae9-720b-4bfc-b9d1-99cdfc4ca9c6 req-12e20945-639d-4a71-8eed-3c0cb778cf0d service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:41 user nova-compute[70659]: WARNING nova.compute.manager [req-0a1a6ae9-720b-4bfc-b9d1-99cdfc4ca9c6 req-12e20945-639d-4a71-8eed-3c0cb778cf0d service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state active and task_state resize_finish.
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGVotEsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:09:42 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:09:42 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:09:42 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[460b3ed0-3f41-4e3b-95f5-ca19a4860600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:09:42 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf24f64-9186-468c-a6f7-97bb51c7ffb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2] added
Jul 25 17:09:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb1ed18-4bc2-4685-81b8-1e2e22ff9f11]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70b532b-779b-4937-99f4-52e72a1e8adf]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGVotEsr {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGVotEsr" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3652fb8a-7617-420d-aecb-95cf99137482]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZGVotEsr'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[355935e0-c845-4483-981d-d9d15ebb9993]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbedb582-5415-4264-b3d4-351328c7e955]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf684c8-578a-41fc-b734-bddb357d78dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2, portal: 172.16.0.220,3260]
Jul 25 17:09:42 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2, portal: 172.16.0.220,3260] successful.
Jul 25 17:09:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e56ef4-4cbc-4a10-a037-9cfe979d99b7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d147df2c-7c85-45aa-a7f3-ec6b7a4d9433]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 (non-flash)
Jul 25 17:09:42 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[295a9208-ae54-4ca4-a3ad-41ff18bed180]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for 940f2d84-8561-4345-a291-819dc67abba8 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304982.9057128, 940f2d84-8561-4345-a291-819dc67abba8 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:09:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] VM Resumed (Lifecycle Event)
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:09:42 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Instance running successfully.
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Failed to set time: agent not configured {{(pid=70659) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7142a436-e51a-4996-930f-b446b98d089b tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] finish_migration finished successfully. {{(pid=70659) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:09:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690304982.9067833, 940f2d84-8561-4345-a291-819dc67abba8 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:09:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] VM Started (Lifecycle Event)
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:09:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:09:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 17:09:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-51b4de10-1814-4311-a9fc-088b33d4e57e req-9b7629db-747d-4e03-a43c-b08703a5a030 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-51b4de10-1814-4311-a9fc-088b33d4e57e req-9b7629db-747d-4e03-a43c-b08703a5a030 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-51b4de10-1814-4311-a9fc-088b33d4e57e req-9b7629db-747d-4e03-a43c-b08703a5a030 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-51b4de10-1814-4311-a9fc-088b33d4e57e req-9b7629db-747d-4e03-a43c-b08703a5a030 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-51b4de10-1814-4311-a9fc-088b33d4e57e req-9b7629db-747d-4e03-a43c-b08703a5a030 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:43 user nova-compute[70659]: WARNING nova.compute.manager [req-51b4de10-1814-4311-a9fc-088b33d4e57e req-9b7629db-747d-4e03-a43c-b08703a5a030 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state resized and task_state None.
Jul 25 17:09:43 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGVotEsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23238613636363061', 'path': '/dev/sdd'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238613636363061', 'path': '/dev/sdd'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'flavor' on Instance uuid fdea0673-35e9-4e1f-be7c-dc942986dc89 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:09:43 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:09:43 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 17:09:43 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:09:43 user nova-compute[70659]:   <serial>d3ad77b7-38b5-4ad9-8508-54999251c7c2</serial>
Jul 25 17:09:43 user nova-compute[70659]: </disk>
Jul 25 17:09:43 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:09:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:09:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:09:44 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No VIF found with MAC fa:16:3e:95:eb:51, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:09:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90b969c8-29ee-41bd-af65-038e3de007a7 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.608s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:45 user nova-compute[70659]: INFO nova.compute.manager [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Detaching volume d3ad77b7-38b5-4ad9-8508-54999251c7c2
Jul 25 17:09:45 user nova-compute[70659]: INFO nova.virt.block_device [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Attempting to driver detach volume d3ad77b7-38b5-4ad9-8508-54999251c7c2 from mountpoint /dev/vdb
Jul 25 17:09:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Attempting to detach device vdb from instance fdea0673-35e9-4e1f-be7c-dc942986dc89 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:09:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:09:45 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:09:45 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 17:09:45 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:09:45 user nova-compute[70659]:   <serial>d3ad77b7-38b5-4ad9-8508-54999251c7c2</serial>
Jul 25 17:09:45 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:09:45 user nova-compute[70659]: </disk>
Jul 25 17:09:45 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:09:45 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully detached device vdb from instance fdea0673-35e9-4e1f-be7c-dc942986dc89 from the persistent domain config.
Jul 25 17:09:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdea0673-35e9-4e1f-be7c-dc942986dc89 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:09:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:09:45 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:09:45 user nova-compute[70659]:   <source dev="/dev/sdd"/>
Jul 25 17:09:45 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:09:45 user nova-compute[70659]:   <serial>d3ad77b7-38b5-4ad9-8508-54999251c7c2</serial>
Jul 25 17:09:45 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:09:45 user nova-compute[70659]: </disk>
Jul 25 17:09:45 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690304986.2413821, fdea0673-35e9-4e1f-be7c-dc942986dc89 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdea0673-35e9-4e1f-be7c-dc942986dc89 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:09:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully detached device vdb from instance fdea0673-35e9-4e1f-be7c-dc942986dc89 from the live domain config.
Jul 25 17:09:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGVotEsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:09:46 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[09da5f3f-32e4-4fc3-81b0-cc96a37d0274]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[00098b38-0ac0-42e3-ada3-2255372288c0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:46 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:46 user nova-compute[70659]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 (non-flash)
Jul 25 17:09:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:46 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:46 user nova-compute[70659]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 (non-flash)
Jul 25 17:09:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30584e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2'): ({'sdd'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Removing single pathed devices sdd {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1971c49-3695-42b6-a030-ce264d3d7e10]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f783baf-17e0-49d4-b18e-0230b10adc86]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flushing IO for device /dev/sdd {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1f4768-3054-414a-b5b9-cda44aee790a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f433af9e-eff3-4490-a11d-9277a2046af2]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d4aae2-b8c0-4f59-ab73-675eb235a125]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7686e7-123a-44a2-9222-b6804dee5af8]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2, portal: 172.16.0.220,3260]
Jul 25 17:09:46 user nova-compute[70659]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2, portal: 172.16.0.220,3260] successful.
Jul 25 17:09:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ad77b7-38b5-4ad9-8508-54999251c7c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[220b0458-9a11-473a-81c5-7d24bc89ad46]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] <== disconnect_volume: return (288ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:09:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:09:47 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'flavor' on Instance uuid fdea0673-35e9-4e1f-be7c-dc942986dc89 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4c59d063-85de-43ef-b499-cd13f3fc1e7e tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.609s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:09:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "73980900-2093-4338-8460-d91df2e2709d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:51 user nova-compute[70659]: INFO nova.compute.manager [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Terminating instance
Jul 25 17:09:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:09:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-ae6dd9b9-7712-4be6-9408-be1cdf1dd53f req-27f14d2e-a82e-4401-976b-c9958e6b7818 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-unplugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ae6dd9b9-7712-4be6-9408-be1cdf1dd53f req-27f14d2e-a82e-4401-976b-c9958e6b7818 service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ae6dd9b9-7712-4be6-9408-be1cdf1dd53f req-27f14d2e-a82e-4401-976b-c9958e6b7818 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ae6dd9b9-7712-4be6-9408-be1cdf1dd53f req-27f14d2e-a82e-4401-976b-c9958e6b7818 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-ae6dd9b9-7712-4be6-9408-be1cdf1dd53f req-27f14d2e-a82e-4401-976b-c9958e6b7818 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-unplugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-ae6dd9b9-7712-4be6-9408-be1cdf1dd53f req-27f14d2e-a82e-4401-976b-c9958e6b7818 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-unplugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:52 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] Instance destroyed successfully.
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'resources' on Instance uuid 73980900-2093-4338-8460-d91df2e2709d {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1788636919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1788636919',id=21,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:56:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-5jvc40sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:57:50Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=73980900-2093-4338-8460-d91df2e2709d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "address": "fa:16:3e:27:fd:9a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46fdf795-f2", "ovs_interfaceid": "46fdf795-f2fd-419b-96b3-9c45c3fe9a44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:fd:9a,bridge_name='br-int',has_traffic_filtering=True,id=46fdf795-f2fd-419b-96b3-9c45c3fe9a44,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46fdf795-f2') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_vif [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:fd:9a,bridge_name='br-int',has_traffic_filtering=True,id=46fdf795-f2fd-419b-96b3-9c45c3fe9a44,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46fdf795-f2') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46fdf795-f2, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:09:52 user nova-compute[70659]: INFO os_vif [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:fd:9a,bridge_name='br-int',has_traffic_filtering=True,id=46fdf795-f2fd-419b-96b3-9c45c3fe9a44,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46fdf795-f2')
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PgyGcDmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:09:52 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab8162-e47b-4a81-a379-8ce6057bc754]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ebbf9d-d573-47fc-b99f-4e7f0d6c1a0e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:52 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:52 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 (non-flash)
Jul 25 17:09:52 user nova-compute[70659]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:09:52 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30584670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970'): ({'sdc'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Removing single pathed devices sdc {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e7b596-ac3b-478d-bf9a-6b27fb4de727]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[003fcf5c-5e90-434b-86b9-d4f6c5e44644]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Flushing IO for device /dev/sdc {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2d74c3-3ea4-459b-a6bf-d03be88929cb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f40f2-b34b-4e3b-b74c-620188e6e771]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86eab24-10c1-45c7-bafd-8031eee512e4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc989442-79b0-4725-aac0-7e3322eea050]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970, portal: 172.16.0.220,3260]
Jul 25 17:09:52 user nova-compute[70659]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970, portal: 172.16.0.220,3260] successful.
Jul 25 17:09:52 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929c72cf-3ffe-49a9-b089-888195ea9970 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25af648-67a9-4964-ae84-39cef1bda4fd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] <== disconnect_volume: return (291ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:09:52 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Deleting instance files /opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d_del
Jul 25 17:09:52 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Deletion of /opt/stack/data/nova/instances/73980900-2093-4338-8460-d91df2e2709d_del complete
Jul 25 17:09:52 user nova-compute[70659]: INFO nova.compute.manager [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 25 17:09:52 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:09:52 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:09:53 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:09:53 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] Took 0.56 seconds to deallocate network for instance.
Jul 25 17:09:53 user nova-compute[70659]: DEBUG nova.compute.manager [req-401f35a8-9a51-4e3f-ac5a-8a16902a59b9 req-704f834f-1c11-4b1d-bcbc-09f506adfb0c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-deleted-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:53 user nova-compute[70659]: INFO nova.compute.manager [req-401f35a8-9a51-4e3f-ac5a-8a16902a59b9 req-704f834f-1c11-4b1d-bcbc-09f506adfb0c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Neutron deleted interface 46fdf795-f2fd-419b-96b3-9c45c3fe9a44; detaching it from the instance and deleting it from the info cache
Jul 25 17:09:53 user nova-compute[70659]: DEBUG nova.network.neutron [req-401f35a8-9a51-4e3f-ac5a-8a16902a59b9 req-704f834f-1c11-4b1d-bcbc-09f506adfb0c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:09:53 user nova-compute[70659]: DEBUG nova.compute.manager [req-401f35a8-9a51-4e3f-ac5a-8a16902a59b9 req-704f834f-1c11-4b1d-bcbc-09f506adfb0c service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Detach interface failed, port_id=46fdf795-f2fd-419b-96b3-9c45c3fe9a44, reason: Instance 73980900-2093-4338-8460-d91df2e2709d could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 17:09:54 user nova-compute[70659]: INFO nova.compute.manager [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: 73980900-2093-4338-8460-d91df2e2709d] Took 0.73 seconds to detach 1 volumes for instance.
Jul 25 17:09:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-fdcd3c7a-f873-4578-a90f-98951e97128d req-8d690075-4a21-4d71-bc72-034ea9276e88 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fdcd3c7a-f873-4578-a90f-98951e97128d req-8d690075-4a21-4d71-bc72-034ea9276e88 service nova] Acquiring lock "73980900-2093-4338-8460-d91df2e2709d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fdcd3c7a-f873-4578-a90f-98951e97128d req-8d690075-4a21-4d71-bc72-034ea9276e88 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fdcd3c7a-f873-4578-a90f-98951e97128d req-8d690075-4a21-4d71-bc72-034ea9276e88 service nova] Lock "73980900-2093-4338-8460-d91df2e2709d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-fdcd3c7a-f873-4578-a90f-98951e97128d req-8d690075-4a21-4d71-bc72-034ea9276e88 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] No waiting events found dispatching network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:54 user nova-compute[70659]: WARNING nova.compute.manager [req-fdcd3c7a-f873-4578-a90f-98951e97128d req-8d690075-4a21-4d71-bc72-034ea9276e88 service nova] [instance: 73980900-2093-4338-8460-d91df2e2709d] Received unexpected event network-vif-plugged-46fdf795-f2fd-419b-96b3-9c45c3fe9a44 for instance with vm_state deleted and task_state None.
Jul 25 17:09:54 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:09:54 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:09:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:54 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Deleted allocations for instance 73980900-2093-4338-8460-d91df2e2709d
Jul 25 17:09:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9bba6f3f-56f6-4195-9004-3e91bb3ea2db tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "73980900-2093-4338-8460-d91df2e2709d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.682s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:59 user nova-compute[70659]: INFO nova.compute.manager [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Terminating instance
Jul 25 17:09:59 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-94ab3f09-b9a9-4667-8f16-b28fb92288fa req-7f76280e-4ff1-477c-8db6-c39ed739d319 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received event network-vif-unplugged-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-94ab3f09-b9a9-4667-8f16-b28fb92288fa req-7f76280e-4ff1-477c-8db6-c39ed739d319 service nova] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-94ab3f09-b9a9-4667-8f16-b28fb92288fa req-7f76280e-4ff1-477c-8db6-c39ed739d319 service nova] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-94ab3f09-b9a9-4667-8f16-b28fb92288fa req-7f76280e-4ff1-477c-8db6-c39ed739d319 service nova] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-94ab3f09-b9a9-4667-8f16-b28fb92288fa req-7f76280e-4ff1-477c-8db6-c39ed739d319 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] No waiting events found dispatching network-vif-unplugged-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:09:59 user nova-compute[70659]: DEBUG nova.compute.manager [req-94ab3f09-b9a9-4667-8f16-b28fb92288fa req-7f76280e-4ff1-477c-8db6-c39ed739d319 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received event network-vif-unplugged-96efaf7d-6841-483f-8ba2-ded3327ac82f for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:10:00 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Instance destroyed successfully.
Jul 25 17:10:00 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lazy-loading 'resources' on Instance uuid 5eb4c44f-9955-4203-a3e6-8352cd9045ee {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-115601352',display_name='tempest-TestServerVolumeAttachmentScenario-server-115601352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-115601352',id=37,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpMVZDTLQd9LFhWIVcUj8kwYcCqR8kSGADQO5iIWATEo5y4KEfRWx+5MMK3K3Ynnp4N5JnXndzif3p/adl+rV2CllN7JNsLNvMLHnK2ofIKbPBkYROozt6HPw5Zg3etaw==',key_name='tempest-keypair-1044882777',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:06:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aff2a3c733c94c5992af0aabab215a22',ramdisk_id='',reservation_id='r-oxkmkz67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-743665487',owner_user_name='tempest-TestServerVolumeAttachmentScenario-743665487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30a6a0a3df2e4e7fbf7a7c016b4dda9f',uuid=5eb4c44f-9955-4203-a3e6-8352cd9045ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Converting VIF {"id": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "address": "fa:16:3e:8b:30:1a", "network": {"id": "4bec5172-9cb2-418a-8a65-c295dc90c537", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2011222947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aff2a3c733c94c5992af0aabab215a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96efaf7d-68", "ovs_interfaceid": "96efaf7d-6841-483f-8ba2-ded3327ac82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=96efaf7d-6841-483f-8ba2-ded3327ac82f,network=Network(4bec5172-9cb2-418a-8a65-c295dc90c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96efaf7d-68') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG os_vif [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=96efaf7d-6841-483f-8ba2-ded3327ac82f,network=Network(4bec5172-9cb2-418a-8a65-c295dc90c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96efaf7d-68') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96efaf7d-68, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:10:00 user nova-compute[70659]: INFO os_vif [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:30:1a,bridge_name='br-int',has_traffic_filtering=True,id=96efaf7d-6841-483f-8ba2-ded3327ac82f,network=Network(4bec5172-9cb2-418a-8a65-c295dc90c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96efaf7d-68')
Jul 25 17:10:00 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Deleting instance files /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee_del
Jul 25 17:10:00 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Deletion of /opt/stack/data/nova/instances/5eb4c44f-9955-4203-a3e6-8352cd9045ee_del complete
Jul 25 17:10:00 user nova-compute[70659]: INFO nova.compute.manager [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 25 17:10:00 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:10:00 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:01 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Took 0.85 seconds to deallocate network for instance.
Jul 25 17:10:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-0a510e4c-af2e-4613-bccf-5c53145038a2 req-e75eac85-011e-484d-adb1-bfa4d35e2679 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received event network-vif-deleted-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:01 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Deleted allocations for instance 5eb4c44f-9955-4203-a3e6-8352cd9045ee
Jul 25 17:10:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b5dcb8c4-0534-4975-a945-ec94afc2a0f8 tempest-TestServerVolumeAttachmentScenario-743665487 tempest-TestServerVolumeAttachmentScenario-743665487-project-member] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-e5d89167-fdac-4156-ba92-0c97cd77ba76 req-a6a471b5-00ac-4ebd-83a1-cf579a8585d1 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received event network-vif-plugged-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e5d89167-fdac-4156-ba92-0c97cd77ba76 req-a6a471b5-00ac-4ebd-83a1-cf579a8585d1 service nova] Acquiring lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e5d89167-fdac-4156-ba92-0c97cd77ba76 req-a6a471b5-00ac-4ebd-83a1-cf579a8585d1 service nova] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e5d89167-fdac-4156-ba92-0c97cd77ba76 req-a6a471b5-00ac-4ebd-83a1-cf579a8585d1 service nova] Lock "5eb4c44f-9955-4203-a3e6-8352cd9045ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-e5d89167-fdac-4156-ba92-0c97cd77ba76 req-a6a471b5-00ac-4ebd-83a1-cf579a8585d1 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] No waiting events found dispatching network-vif-plugged-96efaf7d-6841-483f-8ba2-ded3327ac82f {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:01 user nova-compute[70659]: WARNING nova.compute.manager [req-e5d89167-fdac-4156-ba92-0c97cd77ba76 req-a6a471b5-00ac-4ebd-83a1-cf579a8585d1 service nova] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Received unexpected event network-vif-plugged-96efaf7d-6841-483f-8ba2-ded3327ac82f for instance with vm_state deleted and task_state None.
Jul 25 17:10:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:10:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:10:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:05 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:10:06 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:10:06 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:10:06 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8037MB free_disk=25.111934661865234GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:06 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Applying migration context for instance 940f2d84-8561-4345-a291-819dc67abba8 as it has an incoming, in-progress migration b921e653-b786-4278-946f-646d615199ac. Migration status is finished {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 17:10:06 user nova-compute[70659]: INFO nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating resource usage from migration b921e653-b786-4278-946f-646d615199ac
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fc09d930-4a75-490b-a86a-08fe432d778c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance fdea0673-35e9-4e1f-be7c-dc942986dc89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Migration b921e653-b786-4278-946f-646d615199ac is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 940f2d84-8561-4345-a291-819dc67abba8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690304992.453084, 73980900-2093-4338-8460-d91df2e2709d => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:10:07 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 73980900-2093-4338-8460-d91df2e2709d] VM Stopped (Lifecycle Event)
Jul 25 17:10:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-cf9ab189-8157-420c-9d80-6b220bf03ff9 None None] [instance: 73980900-2093-4338-8460-d91df2e2709d] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:10:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:10 user nova-compute[70659]: INFO nova.compute.manager [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Unshelving
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:10:10 user nova-compute[70659]: INFO nova.virt.block_device [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Booting with volume 033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 at /dev/vda
Jul 25 17:10:10 user nova-compute[70659]: DEBUG os_brick.utils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0ec881-e476-4a90-8ffc-3e3aa5b763e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac236782-75c5-40af-9175-64251f5fbfca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b2c0e1-89b5-4b41-a996-3543e199a54a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[666deb06-9269-4a31-a92f-0d0a4860fd49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:10:10 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9376b95-ee8b-4f20-b21f-c89361033ca8]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG os_brick.utils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating existing volume attachment record: 2c93a818-ec5c-48e5-8cf1-4501cdafed20 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating instance_info_cache with network_info: [{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:10:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'flavor' on Instance uuid f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:11 user nova-compute[70659]: INFO nova.compute.manager [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Attaching volume 93e49c5b-ccbf-4d62-aa80-f3cb706d8047 to /dev/vdb
Jul 25 17:10:11 user nova-compute[70659]: DEBUG os_brick.utils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e261de8f-e9ed-4232-9645-8a7b006d87c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec758bad-9760-41c7-8bb8-5fb15639d9d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dde2689-0cec-4b13-9413-dfe531cba8f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed2147d-3ef7-4881-b4be-fb84140af220]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:10:12 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:10:12 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[349546f6-d637-4c39-95f0-390e124ecd8a]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG os_brick.utils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating existing volume attachment record: a4ca3e69-9516-4277-a855-b798b4af48c4 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:10:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:15 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305000.2528007, 5eb4c44f-9955-4203-a3e6-8352cd9045ee => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:10:15 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] VM Stopped (Lifecycle Event)
Jul 25 17:10:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ce6fea64-4ce7-40ef-890d-8565783886ab None None] [instance: 5eb4c44f-9955-4203-a3e6-8352cd9045ee] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lazy-loading 'pci_requests' on Instance uuid 8cf2697d-18c1-49bd-9f7f-08885d943672 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:10:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cf2697d-18c1-49bd-9f7f-08885d943672 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:10:17 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:10:17 user nova-compute[70659]: INFO nova.compute.claims [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Claim successful on node user
Jul 25 17:10:17 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:10:17 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:10:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:17 user nova-compute[70659]: INFO nova.network.neutron [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquired lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-821c2ef3-465f-41ac-b779-2e613e7014d6 req-3f80a74d-215d-42fc-9832-43b8bfb1ad6b service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-821c2ef3-465f-41ac-b779-2e613e7014d6 req-3f80a74d-215d-42fc-9832-43b8bfb1ad6b service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing instance network info cache due to event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-821c2ef3-465f-41ac-b779-2e613e7014d6 req-3f80a74d-215d-42fc-9832-43b8bfb1ad6b service nova] Acquiring lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPSFqJgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:10:18 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:10:18 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:10:18 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23c1198-299f-47f2-bf4e-24bed63972d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:10:18 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f064128e-e6df-4800-8ea6-674ad24f3f08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047] added
Jul 25 17:10:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd4d93-bdba-4425-92d8-576e0d9cc3f3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e7941-40b2-4aee-bbb3-6c634945081c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPSFqJgv {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPSFqJgv" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2216836d-dee1-4b6f-ba20-25461bd4adb3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nPSFqJgv'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[889377f3-ed0c-4cf5-ac47-34fe964d3203]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef307d8-9b4e-48a2-861a-2bffe5d14720]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:10:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:10:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[42221f66-13e2-43e1-8b2a-4563231921ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047, portal: 172.16.0.220,3260]
Jul 25 17:10:18 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047, portal: 172.16.0.220,3260] successful.
Jul 25 17:10:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45e4bf3-670a-4b89-a232-9188b564f010]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb7febf-42c6-49cc-bf77-fc3192338370]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:10:18 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:10:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:10:18 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:10:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deff920-34e6-4afe-8227-d96a5a78922b]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:10:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPSFqJgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.network.neutron [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating instance_info_cache with network_info: [{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Releasing lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:10:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Creating image(s)
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Ensure instance console log exists: /opt/stack/data/nova/instances/8cf2697d-18c1-49bd-9f7f-08885d943672/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Start _get_guest_xml network_info=[{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2c93a818-ec5c-48e5-8cf1-4501cdafed20', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhMcJqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8cf2697d-18c1-49bd-9f7f-08885d943672', 'attached_at': '', 'detached_at': '', 'volume_id': '033a1f84-c53f-4b09-8cbf-ef5d00ac01d5', 'serial': '033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-821c2ef3-465f-41ac-b779-2e613e7014d6 req-3f80a74d-215d-42fc-9832-43b8bfb1ad6b service nova] Acquired lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-821c2ef3-465f-41ac-b779-2e613e7014d6 req-3f80a74d-215d-42fc-9832-43b8bfb1ad6b service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:10:19 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:10:19 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.objects.instance [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8cf2697d-18c1-49bd-9f7f-08885d943672 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhMcJqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:10:19 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:10:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-821c2ef3-465f-41ac-b779-2e613e7014d6 req-3f80a74d-215d-42fc-9832-43b8bfb1ad6b service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updated VIF entry in instance network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-821c2ef3-465f-41ac-b779-2e613e7014d6 req-3f80a74d-215d-42fc-9832-43b8bfb1ad6b service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating instance_info_cache with network_info: [{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-821c2ef3-465f-41ac-b779-2e613e7014d6 req-3f80a74d-215d-42fc-9832-43b8bfb1ad6b service nova] Releasing lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23333373939626131', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333373939626131', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.803s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:10:19 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:10:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:10:19 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'flavor' on Instance uuid f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bad815-5bea-47ff-962b-9ab30c2230d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:10:19 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:10:19 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:10:19 user nova-compute[70659]:   <source dev="/dev/sdc"/>
Jul 25 17:10:19 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:10:19 user nova-compute[70659]:   <serial>93e49c5b-ccbf-4d62-aa80-f3cb706d8047</serial>
Jul 25 17:10:19 user nova-compute[70659]: </disk>
Jul 25 17:10:19 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[90906663-98f6-4540-b2ae-ea6994df6ede]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5] added
Jul 25 17:10:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[960e8ea5-9c7b-49a4-ad67-54d5d3739da6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e2b0b9-2243-44f4-9b8c-4461d51ed62a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhMcJqeY {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhMcJqeY" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[908dabfb-b5b1-4eea-a852-5274c86cd3e9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VhMcJqeY'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[949010f2-0eaf-4da5-95f1-cf09ad7b2a52]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee054785-19a7-4c6f-8554-5921e08af68f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e0f0d6-07dc-42c4-8c39-11190a4606ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260]
Jul 25 17:10:20 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260] successful.
Jul 25 17:10:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef38c0e-c54b-49fe-ba0e-5a96f791196e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[671628aa-e815-4511-abb9-cf41fbd3ac84]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:10:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b794318-09a2-425a-9a58-55ea46367d64]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] No VIF found with MAC fa:16:3e:fc:fa:91, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:10:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7440032e-ac76-47a9-b60d-ed6660bf4e82 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.589s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhMcJqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] <== connect_volume: return (2130ms) {'type': 'block', 'scsi_wwn': '23630343439336166', 'path': '/dev/sdd'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630343439336166', 'path': '/dev/sdd'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T17:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385776309',display_name='tempest-TestShelveInstance-server-1385776309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385776309',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1694808483',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:06:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='930ca993f8d04c03b073fbe183f064de',ramdisk_id='',reservation_id='r-tc9ckny8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-396312487',owner_user_name='tempest-TestShelveInstance-396312487-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:10:10Z,user_data=None,user_id='7c9f4887220e4691b50538353a898b73',uuid=8cf2697d-18c1-49bd-9f7f-08885d943672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converting VIF {"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.objects.instance [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cf2697d-18c1-49bd-9f7f-08885d943672 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:10:21 user nova-compute[70659]:   <uuid>8cf2697d-18c1-49bd-9f7f-08885d943672</uuid>
Jul 25 17:10:21 user nova-compute[70659]:   <name>instance-00000026</name>
Jul 25 17:10:21 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:10:21 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:10:21 user nova-compute[70659]:   <metadata>
Jul 25 17:10:21 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:10:21 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:10:21 user nova-compute[70659]:       <nova:name>tempest-TestShelveInstance-server-1385776309</nova:name>
Jul 25 17:10:21 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:10:19</nova:creationTime>
Jul 25 17:10:21 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:10:21 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:10:21 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:10:21 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:10:21 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:10:21 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:10:21 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:10:21 user nova-compute[70659]:       <nova:owner>
Jul 25 17:10:21 user nova-compute[70659]:         <nova:user uuid="7c9f4887220e4691b50538353a898b73">tempest-TestShelveInstance-396312487-project-member</nova:user>
Jul 25 17:10:21 user nova-compute[70659]:         <nova:project uuid="930ca993f8d04c03b073fbe183f064de">tempest-TestShelveInstance-396312487</nova:project>
Jul 25 17:10:21 user nova-compute[70659]:       </nova:owner>
Jul 25 17:10:21 user nova-compute[70659]:       <nova:ports>
Jul 25 17:10:21 user nova-compute[70659]:         <nova:port uuid="3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a">
Jul 25 17:10:21 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 17:10:21 user nova-compute[70659]:         </nova:port>
Jul 25 17:10:21 user nova-compute[70659]:       </nova:ports>
Jul 25 17:10:21 user nova-compute[70659]:     </nova:instance>
Jul 25 17:10:21 user nova-compute[70659]:   </metadata>
Jul 25 17:10:21 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:10:21 user nova-compute[70659]:     <system>
Jul 25 17:10:21 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:10:21 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:10:21 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:10:21 user nova-compute[70659]:       <entry name="serial">8cf2697d-18c1-49bd-9f7f-08885d943672</entry>
Jul 25 17:10:21 user nova-compute[70659]:       <entry name="uuid">8cf2697d-18c1-49bd-9f7f-08885d943672</entry>
Jul 25 17:10:21 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:10:21 user nova-compute[70659]:     </system>
Jul 25 17:10:21 user nova-compute[70659]:   </sysinfo>
Jul 25 17:10:21 user nova-compute[70659]:   <os>
Jul 25 17:10:21 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:10:21 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:10:21 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:10:21 user nova-compute[70659]:   </os>
Jul 25 17:10:21 user nova-compute[70659]:   <features>
Jul 25 17:10:21 user nova-compute[70659]:     <acpi/>
Jul 25 17:10:21 user nova-compute[70659]:     <apic/>
Jul 25 17:10:21 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:10:21 user nova-compute[70659]:   </features>
Jul 25 17:10:21 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:10:21 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:10:21 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:10:21 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:10:21 user nova-compute[70659]:   </clock>
Jul 25 17:10:21 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:10:21 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:10:21 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:10:21 user nova-compute[70659]:   </cpu>
Jul 25 17:10:21 user nova-compute[70659]:   <devices>
Jul 25 17:10:21 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:10:21 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:10:21 user nova-compute[70659]:       <source dev="/dev/sdd"/>
Jul 25 17:10:21 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:10:21 user nova-compute[70659]:       <serial>033a1f84-c53f-4b09-8cbf-ef5d00ac01d5</serial>
Jul 25 17:10:21 user nova-compute[70659]:     </disk>
Jul 25 17:10:21 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:10:21 user nova-compute[70659]:       <mac address="fa:16:3e:22:31:55"/>
Jul 25 17:10:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:10:21 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:10:21 user nova-compute[70659]:       <target dev="tap3b7df7d2-e4"/>
Jul 25 17:10:21 user nova-compute[70659]:     </interface>
Jul 25 17:10:21 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:10:21 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/8cf2697d-18c1-49bd-9f7f-08885d943672/console.log" append="off"/>
Jul 25 17:10:21 user nova-compute[70659]:     </serial>
Jul 25 17:10:21 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:10:21 user nova-compute[70659]:     <video>
Jul 25 17:10:21 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:10:21 user nova-compute[70659]:     </video>
Jul 25 17:10:21 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:10:21 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:10:21 user nova-compute[70659]:     </rng>
Jul 25 17:10:21 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:10:21 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:10:21 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:10:21 user nova-compute[70659]:     </memballoon>
Jul 25 17:10:21 user nova-compute[70659]:   </devices>
Jul 25 17:10:21 user nova-compute[70659]: </domain>
Jul 25 17:10:21 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T17:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385776309',display_name='tempest-TestShelveInstance-server-1385776309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385776309',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1694808483',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:06:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='930ca993f8d04c03b073fbe183f064de',ramdisk_id='',reservation_id='r-tc9ckny8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-396312487',owner_user_name='tempest-TestShelveInstance-396312487-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:10:10Z,user_data=None,user_id='7c9f4887220e4691b50538353a898b73',uuid=8cf2697d-18c1-49bd-9f7f-08885d943672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converting VIF {"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG os_vif [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b7df7d2-e4, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b7df7d2-e4, col_values=(('external_ids', {'iface-id': '3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:31:55', 'vm-uuid': '8cf2697d-18c1-49bd-9f7f-08885d943672'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:21 user nova-compute[70659]: INFO os_vif [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4')
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:10:21 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] No VIF found with MAC fa:16:3e:22:31:55, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-e1fc462e-f706-4713-9112-c58da9952573 req-479fc218-d7ab-48d1-811e-9f83e97868c0 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e1fc462e-f706-4713-9112-c58da9952573 req-479fc218-d7ab-48d1-811e-9f83e97868c0 service nova] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e1fc462e-f706-4713-9112-c58da9952573 req-479fc218-d7ab-48d1-811e-9f83e97868c0 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e1fc462e-f706-4713-9112-c58da9952573 req-479fc218-d7ab-48d1-811e-9f83e97868c0 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-e1fc462e-f706-4713-9112-c58da9952573 req-479fc218-d7ab-48d1-811e-9f83e97868c0 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] No waiting events found dispatching network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:22 user nova-compute[70659]: WARNING nova.compute.manager [req-e1fc462e-f706-4713-9112-c58da9952573 req-479fc218-d7ab-48d1-811e-9f83e97868c0 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received unexpected event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 17:10:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-e1db8db8-2c96-430c-aaf0-14cd6107a9cd req-cdc5530d-00bc-462d-b627-50333d180166 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-e1db8db8-2c96-430c-aaf0-14cd6107a9cd req-cdc5530d-00bc-462d-b627-50333d180166 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing instance network info cache due to event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:10:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e1db8db8-2c96-430c-aaf0-14cd6107a9cd req-cdc5530d-00bc-462d-b627-50333d180166 service nova] Acquiring lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:10:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e1db8db8-2c96-430c-aaf0-14cd6107a9cd req-cdc5530d-00bc-462d-b627-50333d180166 service nova] Acquired lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:10:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-e1db8db8-2c96-430c-aaf0-14cd6107a9cd req-cdc5530d-00bc-462d-b627-50333d180166 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-e1db8db8-2c96-430c-aaf0-14cd6107a9cd req-cdc5530d-00bc-462d-b627-50333d180166 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updated VIF entry in instance network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-e1db8db8-2c96-430c-aaf0-14cd6107a9cd req-cdc5530d-00bc-462d-b627-50333d180166 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating instance_info_cache with network_info: [{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e1db8db8-2c96-430c-aaf0-14cd6107a9cd req-cdc5530d-00bc-462d-b627-50333d180166 service nova] Releasing lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305024.7557852, 8cf2697d-18c1-49bd-9f7f-08885d943672 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:10:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] VM Resumed (Lifecycle Event)
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:10:24 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Instance spawned successfully.
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:10:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305024.7559397, 8cf2697d-18c1-49bd-9f7f-08885d943672 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:10:24 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] VM Started (Lifecycle Event)
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-343517b5-a23c-4a9b-82b6-e997e70807c9 tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.795s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-e40970b6-449e-42b0-91a5-e7e4e6dddfc8 req-1f614b7d-14d3-4494-b937-9cc06e3cd89f service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e40970b6-449e-42b0-91a5-e7e4e6dddfc8 req-1f614b7d-14d3-4494-b937-9cc06e3cd89f service nova] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e40970b6-449e-42b0-91a5-e7e4e6dddfc8 req-1f614b7d-14d3-4494-b937-9cc06e3cd89f service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-e40970b6-449e-42b0-91a5-e7e4e6dddfc8 req-1f614b7d-14d3-4494-b937-9cc06e3cd89f service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:24 user nova-compute[70659]: DEBUG nova.compute.manager [req-e40970b6-449e-42b0-91a5-e7e4e6dddfc8 req-1f614b7d-14d3-4494-b937-9cc06e3cd89f service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] No waiting events found dispatching network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:24 user nova-compute[70659]: WARNING nova.compute.manager [req-e40970b6-449e-42b0-91a5-e7e4e6dddfc8 req-1f614b7d-14d3-4494-b937-9cc06e3cd89f service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received unexpected event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a for instance with vm_state active and task_state None.
Jul 25 17:10:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-f503ba71-e4f9-46ea-9fb4-58580fa93d78 req-fd3d7ce9-6595-4ab6-ac7b-81d7624ad9de service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:25 user nova-compute[70659]: DEBUG nova.compute.manager [req-f503ba71-e4f9-46ea-9fb4-58580fa93d78 req-fd3d7ce9-6595-4ab6-ac7b-81d7624ad9de service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing instance network info cache due to event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:10:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f503ba71-e4f9-46ea-9fb4-58580fa93d78 req-fd3d7ce9-6595-4ab6-ac7b-81d7624ad9de service nova] Acquiring lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:10:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f503ba71-e4f9-46ea-9fb4-58580fa93d78 req-fd3d7ce9-6595-4ab6-ac7b-81d7624ad9de service nova] Acquired lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:10:25 user nova-compute[70659]: DEBUG nova.network.neutron [req-f503ba71-e4f9-46ea-9fb4-58580fa93d78 req-fd3d7ce9-6595-4ab6-ac7b-81d7624ad9de service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:10:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:26 user nova-compute[70659]: INFO nova.compute.manager [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Rebooting instance
Jul 25 17:10:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:10:26 user nova-compute[70659]: DEBUG nova.network.neutron [req-f503ba71-e4f9-46ea-9fb4-58580fa93d78 req-fd3d7ce9-6595-4ab6-ac7b-81d7624ad9de service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updated VIF entry in instance network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:10:26 user nova-compute[70659]: DEBUG nova.network.neutron [req-f503ba71-e4f9-46ea-9fb4-58580fa93d78 req-fd3d7ce9-6595-4ab6-ac7b-81d7624ad9de service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating instance_info_cache with network_info: [{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f503ba71-e4f9-46ea-9fb4-58580fa93d78 req-fd3d7ce9-6595-4ab6-ac7b-81d7624ad9de service nova] Releasing lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:10:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquired lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:10:26 user nova-compute[70659]: DEBUG nova.network.neutron [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:10:27 user nova-compute[70659]: DEBUG nova.network.neutron [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating instance_info_cache with network_info: [{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Releasing lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:10:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-00a8cd6d-572c-4ad8-9eb3-9aa10203e4a0 req-f3bc17ab-ef00-4bca-a837-f188e513b9b6 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-unplugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-00a8cd6d-572c-4ad8-9eb3-9aa10203e4a0 req-f3bc17ab-ef00-4bca-a837-f188e513b9b6 service nova] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-00a8cd6d-572c-4ad8-9eb3-9aa10203e4a0 req-f3bc17ab-ef00-4bca-a837-f188e513b9b6 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-00a8cd6d-572c-4ad8-9eb3-9aa10203e4a0 req-f3bc17ab-ef00-4bca-a837-f188e513b9b6 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-00a8cd6d-572c-4ad8-9eb3-9aa10203e4a0 req-f3bc17ab-ef00-4bca-a837-f188e513b9b6 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] No waiting events found dispatching network-vif-unplugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:29 user nova-compute[70659]: WARNING nova.compute.manager [req-00a8cd6d-572c-4ad8-9eb3-9aa10203e4a0 req-f3bc17ab-ef00-4bca-a837-f188e513b9b6 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received unexpected event network-vif-unplugged-888087ef-4c90-4ce4-817f-b1124f30e30d for instance with vm_state active and task_state reboot_started.
Jul 25 17:10:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Instance shutdown successfully.
Jul 25 17:10:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] No waiting events found dispatching network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:32 user nova-compute[70659]: WARNING nova.compute.manager [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received unexpected event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d for instance with vm_state active and task_state reboot_started.
Jul 25 17:10:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] No waiting events found dispatching network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:32 user nova-compute[70659]: WARNING nova.compute.manager [req-6557fdcd-5036-4224-b04b-d71794f2570f req-bc39b591-319c-431a-a96b-cdc35b303ab5 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received unexpected event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d for instance with vm_state active and task_state reboot_started.
Jul 25 17:10:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 17:10:33 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305033.8742216, f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:10:33 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] VM Resumed (Lifecycle Event)
Jul 25 17:10:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Instance running successfully.
Jul 25 17:10:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Instance soft rebooted successfully.
Jul 25 17:10:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:10:33 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 25 17:10:33 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305033.8770025, f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:10:33 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] VM Started (Lifecycle Event)
Jul 25 17:10:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-356b9b89-a30f-4a22-98bc-4cd8481dba04 tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.551s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:10:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-eafac5a8-4085-429c-9f6b-85728954c31d req-8475fa37-8c0f-4005-aaeb-fa57f49caf96 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-eafac5a8-4085-429c-9f6b-85728954c31d req-8475fa37-8c0f-4005-aaeb-fa57f49caf96 service nova] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-eafac5a8-4085-429c-9f6b-85728954c31d req-8475fa37-8c0f-4005-aaeb-fa57f49caf96 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-eafac5a8-4085-429c-9f6b-85728954c31d req-8475fa37-8c0f-4005-aaeb-fa57f49caf96 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-eafac5a8-4085-429c-9f6b-85728954c31d req-8475fa37-8c0f-4005-aaeb-fa57f49caf96 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] No waiting events found dispatching network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:34 user nova-compute[70659]: WARNING nova.compute.manager [req-eafac5a8-4085-429c-9f6b-85728954c31d req-8475fa37-8c0f-4005-aaeb-fa57f49caf96 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received unexpected event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d for instance with vm_state active and task_state None.
Jul 25 17:10:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:35 user nova-compute[70659]: INFO nova.compute.manager [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Terminating instance
Jul 25 17:10:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-6eea7656-c2f1-43b2-adea-099d9e343aac req-6bcf313e-e1fe-45b3-a828-e7be1e3a1578 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received event network-vif-unplugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6eea7656-c2f1-43b2-adea-099d9e343aac req-6bcf313e-e1fe-45b3-a828-e7be1e3a1578 service nova] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6eea7656-c2f1-43b2-adea-099d9e343aac req-6bcf313e-e1fe-45b3-a828-e7be1e3a1578 service nova] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6eea7656-c2f1-43b2-adea-099d9e343aac req-6bcf313e-e1fe-45b3-a828-e7be1e3a1578 service nova] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-6eea7656-c2f1-43b2-adea-099d9e343aac req-6bcf313e-e1fe-45b3-a828-e7be1e3a1578 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] No waiting events found dispatching network-vif-unplugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-6eea7656-c2f1-43b2-adea-099d9e343aac req-6bcf313e-e1fe-45b3-a828-e7be1e3a1578 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received event network-vif-unplugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:10:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Instance destroyed successfully.
Jul 25 17:10:36 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'resources' on Instance uuid fdea0673-35e9-4e1f-be7c-dc942986dc89 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1126408480',display_name='tempest-AttachVolumeNegativeTest-server-1126408480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1126408480',id=40,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdzTFMrYz3BnVgFLfAvyjBYzQE+XGgIfiPjeN+qakfVifcMk04JiVmjPrc/AD0FXJHD9VwcY4WjC9KjuJtPu0ba+BWg6L8rlKDlw/dJ9k+dhAQlOLoo9reely9xSVJE1w==',key_name='tempest-keypair-1003027889',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:07:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-7d87bfnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:07:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=fdea0673-35e9-4e1f-be7c-dc942986dc89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "address": "fa:16:3e:95:eb:51", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63b7573-ab", "ovs_interfaceid": "b63b7573-ab84-4a4a-97bb-7321bc01cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:eb:51,bridge_name='br-int',has_traffic_filtering=True,id=b63b7573-ab84-4a4a-97bb-7321bc01cb75,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63b7573-ab') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG os_vif [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:eb:51,bridge_name='br-int',has_traffic_filtering=True,id=b63b7573-ab84-4a4a-97bb-7321bc01cb75,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63b7573-ab') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb63b7573-ab, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:10:36 user nova-compute[70659]: INFO os_vif [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:eb:51,bridge_name='br-int',has_traffic_filtering=True,id=b63b7573-ab84-4a4a-97bb-7321bc01cb75,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63b7573-ab')
Jul 25 17:10:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Deleting instance files /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89_del
Jul 25 17:10:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Deletion of /opt/stack/data/nova/instances/fdea0673-35e9-4e1f-be7c-dc942986dc89_del complete
Jul 25 17:10:36 user nova-compute[70659]: INFO nova.compute.manager [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 25 17:10:36 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:10:36 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:10:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:37 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:37 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Took 0.86 seconds to deallocate network for instance.
Jul 25 17:10:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-1fff72c2-9284-43cf-8bee-85e38b0d3044 req-092accb2-f3e1-47fb-8368-6ddc4a3d8365 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received event network-vif-deleted-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:37 user nova-compute[70659]: INFO nova.compute.manager [req-1fff72c2-9284-43cf-8bee-85e38b0d3044 req-092accb2-f3e1-47fb-8368-6ddc4a3d8365 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Neutron deleted interface b63b7573-ab84-4a4a-97bb-7321bc01cb75; detaching it from the instance and deleting it from the info cache
Jul 25 17:10:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-1fff72c2-9284-43cf-8bee-85e38b0d3044 req-092accb2-f3e1-47fb-8368-6ddc4a3d8365 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-1fff72c2-9284-43cf-8bee-85e38b0d3044 req-092accb2-f3e1-47fb-8368-6ddc4a3d8365 service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Detach interface failed, port_id=b63b7573-ab84-4a4a-97bb-7321bc01cb75, reason: Instance fdea0673-35e9-4e1f-be7c-dc942986dc89 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 17:10:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:38 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:10:38 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:10:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:38 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Deleted allocations for instance fdea0673-35e9-4e1f-be7c-dc942986dc89
Jul 25 17:10:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1a620029-9d4d-4843-8d45-2639b00bbbe4 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-241a24aa-58d1-4273-982e-a98410e13516 req-3064c0b4-768f-4b64-b812-60f32f1349ef service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received event network-vif-plugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-241a24aa-58d1-4273-982e-a98410e13516 req-3064c0b4-768f-4b64-b812-60f32f1349ef service nova] Acquiring lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-241a24aa-58d1-4273-982e-a98410e13516 req-3064c0b4-768f-4b64-b812-60f32f1349ef service nova] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-241a24aa-58d1-4273-982e-a98410e13516 req-3064c0b4-768f-4b64-b812-60f32f1349ef service nova] Lock "fdea0673-35e9-4e1f-be7c-dc942986dc89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-241a24aa-58d1-4273-982e-a98410e13516 req-3064c0b4-768f-4b64-b812-60f32f1349ef service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] No waiting events found dispatching network-vif-plugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:38 user nova-compute[70659]: WARNING nova.compute.manager [req-241a24aa-58d1-4273-982e-a98410e13516 req-3064c0b4-768f-4b64-b812-60f32f1349ef service nova] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Received unexpected event network-vif-plugged-b63b7573-ab84-4a4a-97bb-7321bc01cb75 for instance with vm_state deleted and task_state None.
Jul 25 17:10:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "fc09d930-4a75-490b-a86a-08fe432d778c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "fc09d930-4a75-490b-a86a-08fe432d778c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:42 user nova-compute[70659]: INFO nova.compute.manager [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Terminating instance
Jul 25 17:10:42 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-1212f553-c6e8-48bb-bf7e-063cff8eb69e req-f537f508-6eeb-4907-a14f-212ed46365b4 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received event network-vif-unplugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1212f553-c6e8-48bb-bf7e-063cff8eb69e req-f537f508-6eeb-4907-a14f-212ed46365b4 service nova] Acquiring lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1212f553-c6e8-48bb-bf7e-063cff8eb69e req-f537f508-6eeb-4907-a14f-212ed46365b4 service nova] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1212f553-c6e8-48bb-bf7e-063cff8eb69e req-f537f508-6eeb-4907-a14f-212ed46365b4 service nova] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-1212f553-c6e8-48bb-bf7e-063cff8eb69e req-f537f508-6eeb-4907-a14f-212ed46365b4 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] No waiting events found dispatching network-vif-unplugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-1212f553-c6e8-48bb-bf7e-063cff8eb69e req-f537f508-6eeb-4907-a14f-212ed46365b4 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received event network-vif-unplugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:10:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Instance destroyed successfully.
Jul 25 17:10:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lazy-loading 'resources' on Instance uuid fc09d930-4a75-490b-a86a-08fe432d778c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-3393127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-3393127',id=14,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ef5ee6f08d04772994840a8973da621',ramdisk_id='',reservation_id='r-ol839oyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-191665891',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:53:01Z,user_data=None,user_id='913d51a0ff3746c5bdadd59fdf14e787',uuid=fc09d930-4a75-490b-a86a-08fe432d778c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converting VIF {"id": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "address": "fa:16:3e:c1:31:8a", "network": {"id": "8771ea92-b873-472f-b8f8-4c200217934f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-774146193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ef5ee6f08d04772994840a8973da621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730a2576-68", "ovs_interfaceid": "730a2576-6812-47eb-8d54-c86e3c97f7d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=730a2576-6812-47eb-8d54-c86e3c97f7d6,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730a2576-68') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG os_vif [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=730a2576-6812-47eb-8d54-c86e3c97f7d6,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730a2576-68') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap730a2576-68, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:10:43 user nova-compute[70659]: INFO os_vif [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:31:8a,bridge_name='br-int',has_traffic_filtering=True,id=730a2576-6812-47eb-8d54-c86e3c97f7d6,network=Network(8771ea92-b873-472f-b8f8-4c200217934f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730a2576-68')
Jul 25 17:10:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Deleting instance files /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c_del
Jul 25 17:10:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Deletion of /opt/stack/data/nova/instances/fc09d930-4a75-490b-a86a-08fe432d778c_del complete
Jul 25 17:10:43 user nova-compute[70659]: INFO nova.compute.manager [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Took 0.73 seconds to destroy the instance on the hypervisor.
Jul 25 17:10:43 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:10:43 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:10:44 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Took 0.58 seconds to deallocate network for instance.
Jul 25 17:10:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-d8f79897-7aca-4525-802e-99c345130eca req-c3bcd0da-29f9-40a9-82d8-399fe069dc1c service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received event network-vif-deleted-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:44 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:10:44 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:10:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:44 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Deleted allocations for instance fc09d930-4a75-490b-a86a-08fe432d778c
Jul 25 17:10:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ad8fc509-ca65-4ec0-8502-04899e1992ef tempest-ServerBootFromVolumeStableRescueTest-191665891 tempest-ServerBootFromVolumeStableRescueTest-191665891-project-member] Lock "fc09d930-4a75-490b-a86a-08fe432d778c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.733s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-23c7ecb2-b6d5-4b22-80dd-17130dc0f43d req-96167ce5-8f3a-4ea7-8957-69b159979fd8 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received event network-vif-plugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:10:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-23c7ecb2-b6d5-4b22-80dd-17130dc0f43d req-96167ce5-8f3a-4ea7-8957-69b159979fd8 service nova] Acquiring lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:10:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-23c7ecb2-b6d5-4b22-80dd-17130dc0f43d req-96167ce5-8f3a-4ea7-8957-69b159979fd8 service nova] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:10:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-23c7ecb2-b6d5-4b22-80dd-17130dc0f43d req-96167ce5-8f3a-4ea7-8957-69b159979fd8 service nova] Lock "fc09d930-4a75-490b-a86a-08fe432d778c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:10:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-23c7ecb2-b6d5-4b22-80dd-17130dc0f43d req-96167ce5-8f3a-4ea7-8957-69b159979fd8 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] No waiting events found dispatching network-vif-plugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:10:45 user nova-compute[70659]: WARNING nova.compute.manager [req-23c7ecb2-b6d5-4b22-80dd-17130dc0f43d req-96167ce5-8f3a-4ea7-8957-69b159979fd8 service nova] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Received unexpected event network-vif-plugged-730a2576-6812-47eb-8d54-c86e3c97f7d6 for instance with vm_state deleted and task_state None.
Jul 25 17:10:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:51 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305036.7509415, fdea0673-35e9-4e1f-be7c-dc942986dc89 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:10:51 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] VM Stopped (Lifecycle Event)
Jul 25 17:10:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b776e857-80a9-467f-9281-1a2849fe6033 None None] [instance: fdea0673-35e9-4e1f-be7c-dc942986dc89] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:10:58 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305043.3393056, fc09d930-4a75-490b-a86a-08fe432d778c => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:10:58 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] VM Stopped (Lifecycle Event)
Jul 25 17:10:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-0d951d00-07d1-40e6-a6c4-76d9eb2a2c7a None None] [instance: fc09d930-4a75-490b-a86a-08fe432d778c] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:10:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:00 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:11:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:08 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:11:08 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8095MB free_disk=25.245380401611328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Applying migration context for instance 940f2d84-8561-4345-a291-819dc67abba8 as it has an incoming, in-progress migration b921e653-b786-4278-946f-646d615199ac. Migration status is finished {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 17:11:08 user nova-compute[70659]: INFO nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating resource usage from migration b921e653-b786-4278-946f-646d615199ac
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Migration b921e653-b786-4278-946f-646d615199ac is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 940f2d84-8561-4345-a291-819dc67abba8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 8cf2697d-18c1-49bd-9f7f-08885d943672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:11:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:11 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:11:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:11:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:11:12 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating instance_info_cache with network_info: [{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:11:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Going to confirm migration 2 {{(pid=70659) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4693}}
Jul 25 17:11:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:11:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquired lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:11:16 user nova-compute[70659]: DEBUG nova.network.neutron [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:11:16 user nova-compute[70659]: DEBUG nova.objects.instance [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'info_cache' on Instance uuid 940f2d84-8561-4345-a291-819dc67abba8 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:11:17 user nova-compute[70659]: DEBUG nova.network.neutron [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating instance_info_cache with network_info: [{"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:11:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Releasing lock "refresh_cache-940f2d84-8561-4345-a291-819dc67abba8" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:11:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'migration_context' on Instance uuid 940f2d84-8561-4345-a291-819dc67abba8 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:11:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:17 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:11:17 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:11:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.247s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:17 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Deleted allocation for migration b921e653-b786-4278-946f-646d615199ac
Jul 25 17:11:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5b1509bb-fa28-425e-84c0-e5fc79bcb1a0 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.218s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:11:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:11:31 user nova-compute[70659]: INFO nova.compute.claims [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Claim successful on node user
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:11:31 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.policy [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e925fbb88b3e433abd27fa08a766e4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ed4eae8755454c9e5be953e69c013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:11:31 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Creating image(s)
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "/opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "/opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "/opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk 1073741824" returned: 0 in 0.057s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Successfully created port: c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Cannot resize image /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'migration_context' on Instance uuid 659f3aeb-24fd-435e-a33e-85032edfd446 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Ensure instance console log exists: /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Successfully updated port: c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquired lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-f184d3c6-28e8-4afe-81cb-a1296c1ae5de req-ffa4573f-3930-42f7-8d33-afc521a1d4a9 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received event network-changed-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-f184d3c6-28e8-4afe-81cb-a1296c1ae5de req-ffa4573f-3930-42f7-8d33-afc521a1d4a9 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Refreshing instance network info cache due to event network-changed-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f184d3c6-28e8-4afe-81cb-a1296c1ae5de req-ffa4573f-3930-42f7-8d33-afc521a1d4a9 service nova] Acquiring lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:11:32 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Updating instance_info_cache with network_info: [{"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Releasing lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Instance network_info: |[{"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f184d3c6-28e8-4afe-81cb-a1296c1ae5de req-ffa4573f-3930-42f7-8d33-afc521a1d4a9 service nova] Acquired lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-f184d3c6-28e8-4afe-81cb-a1296c1ae5de req-ffa4573f-3930-42f7-8d33-afc521a1d4a9 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Refreshing network info cache for port c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Start _get_guest_xml network_info=[{"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:11:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:11:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:11:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688764387',display_name='tempest-AttachVolumeNegativeTest-server-688764387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688764387',id=42,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqLQjQLzu/j+1KMJcgXtBzd7uslsfFDvpr0Gp1L9xxcaSfs5/Hy1sokKTdRk5XtrhimK2wmokCTaYz0R3bouRgqBVFOkvYozU4+p6sweY69EsQ/wmiY+bnAHT2DRXIMDg==',key_name='tempest-keypair-308832690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-vysvwf6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=659f3aeb-24fd-435e-a33e-85032edfd446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:89:91,bridge_name='br-int',has_traffic_filtering=True,id=c2f390eb-7a55-4f9e-b68b-2d26d13cf23f,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f390eb-7a') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'pci_devices' on Instance uuid 659f3aeb-24fd-435e-a33e-85032edfd446 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:11:33 user nova-compute[70659]:   <uuid>659f3aeb-24fd-435e-a33e-85032edfd446</uuid>
Jul 25 17:11:33 user nova-compute[70659]:   <name>instance-0000002a</name>
Jul 25 17:11:33 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:11:33 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:11:33 user nova-compute[70659]:   <metadata>
Jul 25 17:11:33 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:11:33 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:11:33 user nova-compute[70659]:       <nova:name>tempest-AttachVolumeNegativeTest-server-688764387</nova:name>
Jul 25 17:11:33 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:11:33</nova:creationTime>
Jul 25 17:11:33 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:11:33 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:11:33 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:11:33 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:11:33 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:11:33 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:11:33 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:11:33 user nova-compute[70659]:       <nova:owner>
Jul 25 17:11:33 user nova-compute[70659]:         <nova:user uuid="e925fbb88b3e433abd27fa08a766e4e8">tempest-AttachVolumeNegativeTest-921778031-project-member</nova:user>
Jul 25 17:11:33 user nova-compute[70659]:         <nova:project uuid="e5ed4eae8755454c9e5be953e69c013a">tempest-AttachVolumeNegativeTest-921778031</nova:project>
Jul 25 17:11:33 user nova-compute[70659]:       </nova:owner>
Jul 25 17:11:33 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:11:33 user nova-compute[70659]:       <nova:ports>
Jul 25 17:11:33 user nova-compute[70659]:         <nova:port uuid="c2f390eb-7a55-4f9e-b68b-2d26d13cf23f">
Jul 25 17:11:33 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 17:11:33 user nova-compute[70659]:         </nova:port>
Jul 25 17:11:33 user nova-compute[70659]:       </nova:ports>
Jul 25 17:11:33 user nova-compute[70659]:     </nova:instance>
Jul 25 17:11:33 user nova-compute[70659]:   </metadata>
Jul 25 17:11:33 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:11:33 user nova-compute[70659]:     <system>
Jul 25 17:11:33 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:11:33 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:11:33 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:11:33 user nova-compute[70659]:       <entry name="serial">659f3aeb-24fd-435e-a33e-85032edfd446</entry>
Jul 25 17:11:33 user nova-compute[70659]:       <entry name="uuid">659f3aeb-24fd-435e-a33e-85032edfd446</entry>
Jul 25 17:11:33 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:11:33 user nova-compute[70659]:     </system>
Jul 25 17:11:33 user nova-compute[70659]:   </sysinfo>
Jul 25 17:11:33 user nova-compute[70659]:   <os>
Jul 25 17:11:33 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:11:33 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:11:33 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:11:33 user nova-compute[70659]:   </os>
Jul 25 17:11:33 user nova-compute[70659]:   <features>
Jul 25 17:11:33 user nova-compute[70659]:     <acpi/>
Jul 25 17:11:33 user nova-compute[70659]:     <apic/>
Jul 25 17:11:33 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:11:33 user nova-compute[70659]:   </features>
Jul 25 17:11:33 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:11:33 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:11:33 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:11:33 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:11:33 user nova-compute[70659]:   </clock>
Jul 25 17:11:33 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:11:33 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:11:33 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:11:33 user nova-compute[70659]:   </cpu>
Jul 25 17:11:33 user nova-compute[70659]:   <devices>
Jul 25 17:11:33 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:11:33 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:11:33 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk"/>
Jul 25 17:11:33 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:11:33 user nova-compute[70659]:     </disk>
Jul 25 17:11:33 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:11:33 user nova-compute[70659]:       <mac address="fa:16:3e:b2:89:91"/>
Jul 25 17:11:33 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:11:33 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:11:33 user nova-compute[70659]:       <target dev="tapc2f390eb-7a"/>
Jul 25 17:11:33 user nova-compute[70659]:     </interface>
Jul 25 17:11:33 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:11:33 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/console.log" append="off"/>
Jul 25 17:11:33 user nova-compute[70659]:     </serial>
Jul 25 17:11:33 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:11:33 user nova-compute[70659]:     <video>
Jul 25 17:11:33 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:11:33 user nova-compute[70659]:     </video>
Jul 25 17:11:33 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:11:33 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:11:33 user nova-compute[70659]:     </rng>
Jul 25 17:11:33 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:11:33 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:11:33 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:11:33 user nova-compute[70659]:     </memballoon>
Jul 25 17:11:33 user nova-compute[70659]:   </devices>
Jul 25 17:11:33 user nova-compute[70659]: </domain>
Jul 25 17:11:33 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:11:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688764387',display_name='tempest-AttachVolumeNegativeTest-server-688764387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688764387',id=42,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqLQjQLzu/j+1KMJcgXtBzd7uslsfFDvpr0Gp1L9xxcaSfs5/Hy1sokKTdRk5XtrhimK2wmokCTaYz0R3bouRgqBVFOkvYozU4+p6sweY69EsQ/wmiY+bnAHT2DRXIMDg==',key_name='tempest-keypair-308832690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-vysvwf6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=659f3aeb-24fd-435e-a33e-85032edfd446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:89:91,bridge_name='br-int',has_traffic_filtering=True,id=c2f390eb-7a55-4f9e-b68b-2d26d13cf23f,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f390eb-7a') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG os_vif [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:89:91,bridge_name='br-int',has_traffic_filtering=True,id=c2f390eb-7a55-4f9e-b68b-2d26d13cf23f,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f390eb-7a') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2f390eb-7a, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2f390eb-7a, col_values=(('external_ids', {'iface-id': 'c2f390eb-7a55-4f9e-b68b-2d26d13cf23f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:89:91', 'vm-uuid': '659f3aeb-24fd-435e-a33e-85032edfd446'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:33 user nova-compute[70659]: INFO os_vif [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:89:91,bridge_name='br-int',has_traffic_filtering=True,id=c2f390eb-7a55-4f9e-b68b-2d26d13cf23f,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f390eb-7a')
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No VIF found with MAC fa:16:3e:b2:89:91, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-f184d3c6-28e8-4afe-81cb-a1296c1ae5de req-ffa4573f-3930-42f7-8d33-afc521a1d4a9 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Updated VIF entry in instance network info cache for port c2f390eb-7a55-4f9e-b68b-2d26d13cf23f. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG nova.network.neutron [req-f184d3c6-28e8-4afe-81cb-a1296c1ae5de req-ffa4573f-3930-42f7-8d33-afc521a1d4a9 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Updating instance_info_cache with network_info: [{"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:11:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f184d3c6-28e8-4afe-81cb-a1296c1ae5de req-ffa4573f-3930-42f7-8d33-afc521a1d4a9 service nova] Releasing lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:11:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-1971c060-c4c3-4012-82cc-410a987a6750 req-43b8a320-47db-4ac7-afc6-baf605f977da service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received event network-vif-plugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:11:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1971c060-c4c3-4012-82cc-410a987a6750 req-43b8a320-47db-4ac7-afc6-baf605f977da service nova] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1971c060-c4c3-4012-82cc-410a987a6750 req-43b8a320-47db-4ac7-afc6-baf605f977da service nova] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1971c060-c4c3-4012-82cc-410a987a6750 req-43b8a320-47db-4ac7-afc6-baf605f977da service nova] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:35 user nova-compute[70659]: DEBUG nova.compute.manager [req-1971c060-c4c3-4012-82cc-410a987a6750 req-43b8a320-47db-4ac7-afc6-baf605f977da service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] No waiting events found dispatching network-vif-plugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:11:35 user nova-compute[70659]: WARNING nova.compute.manager [req-1971c060-c4c3-4012-82cc-410a987a6750 req-43b8a320-47db-4ac7-afc6-baf605f977da service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received unexpected event network-vif-plugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f for instance with vm_state building and task_state spawning.
Jul 25 17:11:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305096.9215605, 659f3aeb-24fd-435e-a33e-85032edfd446 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:11:36 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] VM Resumed (Lifecycle Event)
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:11:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Instance spawned successfully.
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:36 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305096.9235816, 659f3aeb-24fd-435e-a33e-85032edfd446 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:11:36 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] VM Started (Lifecycle Event)
Jul 25 17:11:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:11:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:11:37 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:11:37 user nova-compute[70659]: INFO nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Took 5.52 seconds to spawn the instance on the hypervisor.
Jul 25 17:11:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:11:37 user nova-compute[70659]: INFO nova.compute.manager [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Took 6.12 seconds to build instance.
Jul 25 17:11:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1b8f5172-38f0-4898-b303-855e6d5b31f0 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.538s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-cab2d19d-22b5-44bd-b17c-818a16c07554 req-656220f9-af10-40bf-9140-234a43a93138 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received event network-vif-plugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:11:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cab2d19d-22b5-44bd-b17c-818a16c07554 req-656220f9-af10-40bf-9140-234a43a93138 service nova] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cab2d19d-22b5-44bd-b17c-818a16c07554 req-656220f9-af10-40bf-9140-234a43a93138 service nova] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-cab2d19d-22b5-44bd-b17c-818a16c07554 req-656220f9-af10-40bf-9140-234a43a93138 service nova] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-cab2d19d-22b5-44bd-b17c-818a16c07554 req-656220f9-af10-40bf-9140-234a43a93138 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] No waiting events found dispatching network-vif-plugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:11:37 user nova-compute[70659]: WARNING nova.compute.manager [req-cab2d19d-22b5-44bd-b17c-818a16c07554 req-656220f9-af10-40bf-9140-234a43a93138 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received unexpected event network-vif-plugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f for instance with vm_state active and task_state None.
Jul 25 17:11:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:11:46 user nova-compute[70659]: INFO nova.compute.claims [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Claim successful on node user
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.network.neutron [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:11:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.policy [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1519b2850b2413a983a498d0cecbf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7318af6ccc485a9a016177fad1b51d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:11:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Creating image(s)
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk 1073741824" returned: 0 in 0.059s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG nova.network.neutron [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Successfully created port: a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Cannot resize image /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG nova.objects.instance [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'migration_context' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Ensure instance console log exists: /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Successfully updated port: a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-f6953ed9-b546-48a1-90c5-0dedda5b927c req-7028517d-cf24-48c4-aa3a-d96098f12728 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-changed-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-f6953ed9-b546-48a1-90c5-0dedda5b927c req-7028517d-cf24-48c4-aa3a-d96098f12728 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Refreshing instance network info cache due to event network-changed-a53e8969-1594-4568-aeb6-80263ee2cf1a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f6953ed9-b546-48a1-90c5-0dedda5b927c req-7028517d-cf24-48c4-aa3a-d96098f12728 service nova] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Instance network_info: |[{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f6953ed9-b546-48a1-90c5-0dedda5b927c req-7028517d-cf24-48c4-aa3a-d96098f12728 service nova] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.neutron [req-f6953ed9-b546-48a1-90c5-0dedda5b927c req-7028517d-cf24-48c4-aa3a-d96098f12728 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Refreshing network info cache for port a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Start _get_guest_xml network_info=[{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:11:48 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:11:48 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-852746328',display_name='tempest-ServerStableDeviceRescueTest-server-852746328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-852746328',id=43,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz3xeqmkXz6C99ZCKhGq25Z5AkBW7ooXchDbKcT5VURn4ody3Vw+lkdLY+/R8IkYRaGlvf2GwFtzi+RnAKdGPBs1OzDVs0QC+JxyJntBwz/nWGExkzaogs55pltBTHKTg==',key_name='tempest-keypair-1452050967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d7318af6ccc485a9a016177fad1b51d',ramdisk_id='',reservation_id='r-evgda7wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-611517675',owner_user_name='tempest-ServerStableDeviceRescueTest-611517675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1519b2850b2413a983a498d0cecbf91',uuid=d37c53e1-18e7-4812-a214-dbffc71e0216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Converting VIF {"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:76:94,bridge_name='br-int',has_traffic_filtering=True,id=a53e8969-1594-4568-aeb6-80263ee2cf1a,network=Network(3200629f-794a-4fdc-a915-18ebcf190430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53e8969-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.objects.instance [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'pci_devices' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:11:48 user nova-compute[70659]:   <uuid>d37c53e1-18e7-4812-a214-dbffc71e0216</uuid>
Jul 25 17:11:48 user nova-compute[70659]:   <name>instance-0000002b</name>
Jul 25 17:11:48 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:11:48 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:11:48 user nova-compute[70659]:   <metadata>
Jul 25 17:11:48 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:11:48 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:11:48 user nova-compute[70659]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-852746328</nova:name>
Jul 25 17:11:48 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:11:48</nova:creationTime>
Jul 25 17:11:48 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:11:48 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:11:48 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:11:48 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:11:48 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:11:48 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:11:48 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:11:48 user nova-compute[70659]:       <nova:owner>
Jul 25 17:11:48 user nova-compute[70659]:         <nova:user uuid="a1519b2850b2413a983a498d0cecbf91">tempest-ServerStableDeviceRescueTest-611517675-project-member</nova:user>
Jul 25 17:11:48 user nova-compute[70659]:         <nova:project uuid="5d7318af6ccc485a9a016177fad1b51d">tempest-ServerStableDeviceRescueTest-611517675</nova:project>
Jul 25 17:11:48 user nova-compute[70659]:       </nova:owner>
Jul 25 17:11:48 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:11:48 user nova-compute[70659]:       <nova:ports>
Jul 25 17:11:48 user nova-compute[70659]:         <nova:port uuid="a53e8969-1594-4568-aeb6-80263ee2cf1a">
Jul 25 17:11:48 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 17:11:48 user nova-compute[70659]:         </nova:port>
Jul 25 17:11:48 user nova-compute[70659]:       </nova:ports>
Jul 25 17:11:48 user nova-compute[70659]:     </nova:instance>
Jul 25 17:11:48 user nova-compute[70659]:   </metadata>
Jul 25 17:11:48 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:11:48 user nova-compute[70659]:     <system>
Jul 25 17:11:48 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:11:48 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:11:48 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:11:48 user nova-compute[70659]:       <entry name="serial">d37c53e1-18e7-4812-a214-dbffc71e0216</entry>
Jul 25 17:11:48 user nova-compute[70659]:       <entry name="uuid">d37c53e1-18e7-4812-a214-dbffc71e0216</entry>
Jul 25 17:11:48 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:11:48 user nova-compute[70659]:     </system>
Jul 25 17:11:48 user nova-compute[70659]:   </sysinfo>
Jul 25 17:11:48 user nova-compute[70659]:   <os>
Jul 25 17:11:48 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:11:48 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:11:48 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:11:48 user nova-compute[70659]:   </os>
Jul 25 17:11:48 user nova-compute[70659]:   <features>
Jul 25 17:11:48 user nova-compute[70659]:     <acpi/>
Jul 25 17:11:48 user nova-compute[70659]:     <apic/>
Jul 25 17:11:48 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:11:48 user nova-compute[70659]:   </features>
Jul 25 17:11:48 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:11:48 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:11:48 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:11:48 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:11:48 user nova-compute[70659]:   </clock>
Jul 25 17:11:48 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:11:48 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:11:48 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:11:48 user nova-compute[70659]:   </cpu>
Jul 25 17:11:48 user nova-compute[70659]:   <devices>
Jul 25 17:11:48 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:11:48 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:11:48 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk"/>
Jul 25 17:11:48 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:11:48 user nova-compute[70659]:     </disk>
Jul 25 17:11:48 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:11:48 user nova-compute[70659]:       <mac address="fa:16:3e:46:76:94"/>
Jul 25 17:11:48 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:11:48 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:11:48 user nova-compute[70659]:       <target dev="tapa53e8969-15"/>
Jul 25 17:11:48 user nova-compute[70659]:     </interface>
Jul 25 17:11:48 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:11:48 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/console.log" append="off"/>
Jul 25 17:11:48 user nova-compute[70659]:     </serial>
Jul 25 17:11:48 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:11:48 user nova-compute[70659]:     <video>
Jul 25 17:11:48 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:11:48 user nova-compute[70659]:     </video>
Jul 25 17:11:48 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:11:48 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:11:48 user nova-compute[70659]:     </rng>
Jul 25 17:11:48 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:11:48 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:11:48 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:11:48 user nova-compute[70659]:     </memballoon>
Jul 25 17:11:48 user nova-compute[70659]:   </devices>
Jul 25 17:11:48 user nova-compute[70659]: </domain>
Jul 25 17:11:48 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-852746328',display_name='tempest-ServerStableDeviceRescueTest-server-852746328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-852746328',id=43,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz3xeqmkXz6C99ZCKhGq25Z5AkBW7ooXchDbKcT5VURn4ody3Vw+lkdLY+/R8IkYRaGlvf2GwFtzi+RnAKdGPBs1OzDVs0QC+JxyJntBwz/nWGExkzaogs55pltBTHKTg==',key_name='tempest-keypair-1452050967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d7318af6ccc485a9a016177fad1b51d',ramdisk_id='',reservation_id='r-evgda7wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-611517675',owner_user_name='tempest-ServerStableDeviceRescueTest-611517675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1519b2850b2413a983a498d0cecbf91',uuid=d37c53e1-18e7-4812-a214-dbffc71e0216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Converting VIF {"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:76:94,bridge_name='br-int',has_traffic_filtering=True,id=a53e8969-1594-4568-aeb6-80263ee2cf1a,network=Network(3200629f-794a-4fdc-a915-18ebcf190430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53e8969-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG os_vif [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:76:94,bridge_name='br-int',has_traffic_filtering=True,id=a53e8969-1594-4568-aeb6-80263ee2cf1a,network=Network(3200629f-794a-4fdc-a915-18ebcf190430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53e8969-15') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa53e8969-15, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa53e8969-15, col_values=(('external_ids', {'iface-id': 'a53e8969-1594-4568-aeb6-80263ee2cf1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:76:94', 'vm-uuid': 'd37c53e1-18e7-4812-a214-dbffc71e0216'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:48 user nova-compute[70659]: INFO os_vif [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:76:94,bridge_name='br-int',has_traffic_filtering=True,id=a53e8969-1594-4568-aeb6-80263ee2cf1a,network=Network(3200629f-794a-4fdc-a915-18ebcf190430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53e8969-15')
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] No VIF found with MAC fa:16:3e:46:76:94, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.neutron [req-f6953ed9-b546-48a1-90c5-0dedda5b927c req-7028517d-cf24-48c4-aa3a-d96098f12728 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updated VIF entry in instance network info cache for port a53e8969-1594-4568-aeb6-80263ee2cf1a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG nova.network.neutron [req-f6953ed9-b546-48a1-90c5-0dedda5b927c req-7028517d-cf24-48c4-aa3a-d96098f12728 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:11:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f6953ed9-b546-48a1-90c5-0dedda5b927c req-7028517d-cf24-48c4-aa3a-d96098f12728 service nova] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:11:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-fe718a65-dd1b-47e5-a3f5-8ff54aec986a req-6490b2a1-8102-42a7-ae0b-4d161addf0b0 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:11:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fe718a65-dd1b-47e5-a3f5-8ff54aec986a req-6490b2a1-8102-42a7-ae0b-4d161addf0b0 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fe718a65-dd1b-47e5-a3f5-8ff54aec986a req-6490b2a1-8102-42a7-ae0b-4d161addf0b0 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fe718a65-dd1b-47e5-a3f5-8ff54aec986a req-6490b2a1-8102-42a7-ae0b-4d161addf0b0 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-fe718a65-dd1b-47e5-a3f5-8ff54aec986a req-6490b2a1-8102-42a7-ae0b-4d161addf0b0 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:11:50 user nova-compute[70659]: WARNING nova.compute.manager [req-fe718a65-dd1b-47e5-a3f5-8ff54aec986a req-6490b2a1-8102-42a7-ae0b-4d161addf0b0 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state building and task_state spawning.
Jul 25 17:11:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305111.9549074, d37c53e1-18e7-4812-a214-dbffc71e0216 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:11:51 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] VM Resumed (Lifecycle Event)
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:11:51 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Instance spawned successfully.
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:51 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:11:52 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:11:52 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305111.9580278, d37c53e1-18e7-4812-a214-dbffc71e0216 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:11:52 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] VM Started (Lifecycle Event)
Jul 25 17:11:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:11:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:11:52 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:11:52 user nova-compute[70659]: INFO nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Took 5.35 seconds to spawn the instance on the hypervisor.
Jul 25 17:11:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:11:52 user nova-compute[70659]: INFO nova.compute.manager [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Took 5.98 seconds to build instance.
Jul 25 17:11:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-38aeb1f7-02d4-4ae5-aa74-65efd4406af1 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.070s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-982ff995-f822-4b5e-a0f5-c7863d880ca8 req-1f0a447c-e1dd-4421-8054-bdfbe57afa19 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:11:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-982ff995-f822-4b5e-a0f5-c7863d880ca8 req-1f0a447c-e1dd-4421-8054-bdfbe57afa19 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:11:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-982ff995-f822-4b5e-a0f5-c7863d880ca8 req-1f0a447c-e1dd-4421-8054-bdfbe57afa19 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:11:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-982ff995-f822-4b5e-a0f5-c7863d880ca8 req-1f0a447c-e1dd-4421-8054-bdfbe57afa19 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:11:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-982ff995-f822-4b5e-a0f5-c7863d880ca8 req-1f0a447c-e1dd-4421-8054-bdfbe57afa19 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:11:52 user nova-compute[70659]: WARNING nova.compute.manager [req-982ff995-f822-4b5e-a0f5-c7863d880ca8 req-1f0a447c-e1dd-4421-8054-bdfbe57afa19 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state active and task_state None.
Jul 25 17:11:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:11:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:11:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 17:11:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 17:11:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-5e0170fe-9448-4c95-8547-5726fd16d306 req-41bf0d1a-7430-4352-b71d-e8f5488a17d1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-5e0170fe-9448-4c95-8547-5726fd16d306 req-41bf0d1a-7430-4352-b71d-e8f5488a17d1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing instance network info cache due to event network-changed-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5e0170fe-9448-4c95-8547-5726fd16d306 req-41bf0d1a-7430-4352-b71d-e8f5488a17d1 service nova] Acquiring lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5e0170fe-9448-4c95-8547-5726fd16d306 req-41bf0d1a-7430-4352-b71d-e8f5488a17d1 service nova] Acquired lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG nova.network.neutron [req-5e0170fe-9448-4c95-8547-5726fd16d306 req-41bf0d1a-7430-4352-b71d-e8f5488a17d1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Refreshing network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:12:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:12:00 user nova-compute[70659]: INFO nova.compute.manager [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Terminating instance
Jul 25 17:12:00 user nova-compute[70659]: DEBUG nova.compute.manager [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-f9bb3ee8-9368-439e-9e90-7b68b014c653 req-653c567f-d270-4da9-aa2a-a0bb731911d2 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-unplugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9bb3ee8-9368-439e-9e90-7b68b014c653 req-653c567f-d270-4da9-aa2a-a0bb731911d2 service nova] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9bb3ee8-9368-439e-9e90-7b68b014c653 req-653c567f-d270-4da9-aa2a-a0bb731911d2 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f9bb3ee8-9368-439e-9e90-7b68b014c653 req-653c567f-d270-4da9-aa2a-a0bb731911d2 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-f9bb3ee8-9368-439e-9e90-7b68b014c653 req-653c567f-d270-4da9-aa2a-a0bb731911d2 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] No waiting events found dispatching network-vif-unplugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.compute.manager [req-f9bb3ee8-9368-439e-9e90-7b68b014c653 req-653c567f-d270-4da9-aa2a-a0bb731911d2 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-unplugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.network.neutron [req-5e0170fe-9448-4c95-8547-5726fd16d306 req-41bf0d1a-7430-4352-b71d-e8f5488a17d1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updated VIF entry in instance network info cache for port 3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.network.neutron [req-5e0170fe-9448-4c95-8547-5726fd16d306 req-41bf0d1a-7430-4352-b71d-e8f5488a17d1 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating instance_info_cache with network_info: [{"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5e0170fe-9448-4c95-8547-5726fd16d306 req-41bf0d1a-7430-4352-b71d-e8f5488a17d1 service nova] Releasing lock "refresh_cache-8cf2697d-18c1-49bd-9f7f-08885d943672" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:12:01 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Instance destroyed successfully.
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.objects.instance [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lazy-loading 'resources' on Instance uuid 8cf2697d-18c1-49bd-9f7f-08885d943672 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T17:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385776309',display_name='tempest-TestShelveInstance-server-1385776309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385776309',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfS7GX2feKTnfrOaK06MJipk+KIrTAhOCa2C2a/Ye7ImGNYQ+C55l3y85Amnav7T5TbVBED5Ch9B2LsPgo7UEH3fC9jrWXUwMvUgcG2wf3WoW0jsTnUS90XFRIDQUyTsg==',key_name='tempest-TestShelveInstance-1694808483',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:10:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930ca993f8d04c03b073fbe183f064de',ramdisk_id='',reservation_id='r-tc9ckny8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-396312487',owner_user_name='tempest-TestShelveInstance-396312487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:10:25Z,user_data=None,user_id='7c9f4887220e4691b50538353a898b73',uuid=8cf2697d-18c1-49bd-9f7f-08885d943672,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converting VIF {"id": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "address": "fa:16:3e:22:31:55", "network": {"id": "9c31db92-c780-485c-b40e-7005470d1a20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239320422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930ca993f8d04c03b073fbe183f064de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7df7d2-e4", "ovs_interfaceid": "3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_vif [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b7df7d2-e4, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:12:01 user nova-compute[70659]: INFO os_vif [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:31:55,bridge_name='br-int',has_traffic_filtering=True,id=3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a,network=Network(9c31db92-c780-485c-b40e-7005470d1a20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7df7d2-e4')
Jul 25 17:12:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhMcJqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:12:01 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b53dad4-69c0-4f28-b6af-93109d750748]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8318f2df-d1cc-43ea-a3f5-4f853bc7b4c6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:12:01 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:12:01 user nova-compute[70659]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:12:01 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:12:01 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:12:01 user nova-compute[70659]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 (non-flash)
Jul 25 17:12:01 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd303644c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5'): ({'sdd'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Removing single pathed devices sdd {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[668432d7-7884-4e20-b6f0-dd87ac96a3f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[518aebd1-36ff-4970-86f5-fd74e1eaee2e]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Flushing IO for device /dev/sdd {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c264a1d-2888-484f-b96f-81a817dc58eb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03a6973-6277-46e2-86db-ae5e50cc83aa]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] SCSI volumes sdd have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2ca930da-604493af81d7b981', '/dev/disk/by-id/scsi-23630343439336166', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ca930da') {{(pid=81811) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7a4a04-6adf-4ec1-88af-951b30bfee50]: (4, None) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[712eb5a0-f660-4afa-877b-f6611005ee0c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6214c647-dfe8-4662-9cdf-ab4cf817c3b3]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260]
Jul 25 17:12:01 user nova-compute[70659]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5, portal: 172.16.0.220,3260] successful.
Jul 25 17:12:01 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e68a53f-f239-4f7c-a9bf-8762a327b14a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] <== disconnect_volume: return (289ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:12:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Deleting instance files /opt/stack/data/nova/instances/8cf2697d-18c1-49bd-9f7f-08885d943672_del
Jul 25 17:12:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Deletion of /opt/stack/data/nova/instances/8cf2697d-18c1-49bd-9f7f-08885d943672_del complete
Jul 25 17:12:02 user nova-compute[70659]: INFO nova.compute.manager [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 25 17:12:02 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:02 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:12:02 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Took 0.57 seconds to deallocate network for instance.
Jul 25 17:12:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:03 user nova-compute[70659]: INFO nova.compute.manager [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Took 0.72 seconds to detach 1 volumes for instance.
Jul 25 17:12:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Deleting volume: 033a1f84-c53f-4b09-8cbf-ef5d00ac01d5 {{(pid=70659) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-1fced6b0-a27c-46bc-8035-2ffe18425908 req-008adef8-5f7c-4aec-8f5f-a748b7fe8041 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1fced6b0-a27c-46bc-8035-2ffe18425908 req-008adef8-5f7c-4aec-8f5f-a748b7fe8041 service nova] Acquiring lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1fced6b0-a27c-46bc-8035-2ffe18425908 req-008adef8-5f7c-4aec-8f5f-a748b7fe8041 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1fced6b0-a27c-46bc-8035-2ffe18425908 req-008adef8-5f7c-4aec-8f5f-a748b7fe8041 service nova] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-1fced6b0-a27c-46bc-8035-2ffe18425908 req-008adef8-5f7c-4aec-8f5f-a748b7fe8041 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] No waiting events found dispatching network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:12:03 user nova-compute[70659]: WARNING nova.compute.manager [req-1fced6b0-a27c-46bc-8035-2ffe18425908 req-008adef8-5f7c-4aec-8f5f-a748b7fe8041 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received unexpected event network-vif-plugged-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a for instance with vm_state active and task_state deleting.
Jul 25 17:12:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-1fced6b0-a27c-46bc-8035-2ffe18425908 req-008adef8-5f7c-4aec-8f5f-a748b7fe8041 service nova] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Received event network-vif-deleted-3b7df7d2-e4a8-4e69-abd6-c84cdc996b0a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:12:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:12:03 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Deleted allocations for instance 8cf2697d-18c1-49bd-9f7f-08885d943672
Jul 25 17:12:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-22a62a5e-905b-4162-ace6-7d241986d52b tempest-TestShelveInstance-396312487 tempest-TestShelveInstance-396312487-project-member] Lock "8cf2697d-18c1-49bd-9f7f-08885d943672" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.999s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:12:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:12:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:12:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:12:09 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:12:09 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8011MB free_disk=25.17941665649414GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 940f2d84-8561-4345-a291-819dc67abba8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 659f3aeb-24fd-435e-a33e-85032edfd446 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d37c53e1-18e7-4812-a214-dbffc71e0216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:12:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:12:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:11 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:12:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:12:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:12:12 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:12:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:12 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating instance_info_cache with network_info: [{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:12:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:12:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:12:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:16 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305121.6919453, 8cf2697d-18c1-49bd-9f7f-08885d943672 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:12:16 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] VM Stopped (Lifecycle Event)
Jul 25 17:12:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9227535d-0df7-4b18-8a53-1157397c1498 None None] [instance: 8cf2697d-18c1-49bd-9f7f-08885d943672] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:12:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 17:12:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-3a6b1efd-a99e-413f-82a4-9d42e9c95387 req-4e5c68b6-6eb0-4700-a069-fa758088baf0 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:12:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-3a6b1efd-a99e-413f-82a4-9d42e9c95387 req-4e5c68b6-6eb0-4700-a069-fa758088baf0 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing instance network info cache due to event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:12:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3a6b1efd-a99e-413f-82a4-9d42e9c95387 req-4e5c68b6-6eb0-4700-a069-fa758088baf0 service nova] Acquiring lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:12:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3a6b1efd-a99e-413f-82a4-9d42e9c95387 req-4e5c68b6-6eb0-4700-a069-fa758088baf0 service nova] Acquired lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:12:18 user nova-compute[70659]: DEBUG nova.network.neutron [req-3a6b1efd-a99e-413f-82a4-9d42e9c95387 req-4e5c68b6-6eb0-4700-a069-fa758088baf0 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:12:18 user nova-compute[70659]: DEBUG nova.network.neutron [req-3a6b1efd-a99e-413f-82a4-9d42e9c95387 req-4e5c68b6-6eb0-4700-a069-fa758088baf0 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updated VIF entry in instance network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:12:18 user nova-compute[70659]: DEBUG nova.network.neutron [req-3a6b1efd-a99e-413f-82a4-9d42e9c95387 req-4e5c68b6-6eb0-4700-a069-fa758088baf0 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating instance_info_cache with network_info: [{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:12:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3a6b1efd-a99e-413f-82a4-9d42e9c95387 req-4e5c68b6-6eb0-4700-a069-fa758088baf0 service nova] Releasing lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:12:19 user nova-compute[70659]: INFO nova.compute.manager [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Detaching volume 93e49c5b-ccbf-4d62-aa80-f3cb706d8047
Jul 25 17:12:19 user nova-compute[70659]: INFO nova.virt.block_device [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Attempting to driver detach volume 93e49c5b-ccbf-4d62-aa80-f3cb706d8047 from mountpoint /dev/vdb
Jul 25 17:12:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Attempting to detach device vdb from instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:12:19 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:12:19 user nova-compute[70659]:   <source dev="/dev/sdc"/>
Jul 25 17:12:19 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:12:19 user nova-compute[70659]:   <serial>93e49c5b-ccbf-4d62-aa80-f3cb706d8047</serial>
Jul 25 17:12:19 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:12:19 user nova-compute[70659]: </disk>
Jul 25 17:12:19 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:12:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully detached device vdb from instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 from the persistent domain config.
Jul 25 17:12:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:12:19 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:12:19 user nova-compute[70659]:   <source dev="/dev/sdc"/>
Jul 25 17:12:19 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:12:19 user nova-compute[70659]:   <serial>93e49c5b-ccbf-4d62-aa80-f3cb706d8047</serial>
Jul 25 17:12:19 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:12:19 user nova-compute[70659]: </disk>
Jul 25 17:12:19 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690305139.6310866, f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:12:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully detached device vdb from instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 from the live domain config.
Jul 25 17:12:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPSFqJgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:12:19 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d454fe5-4820-4852-9dc0-a29f2b9f72d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c102730-0e2a-48ec-ac75-f5b7de5a2754]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:12:19 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:12:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:12:19 user nova-compute[70659]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 (non-flash)
Jul 25 17:12:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30365750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047'): ({'sdc'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Removing single pathed devices sdc {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edc3312-8a2a-42cb-b30a-a7590aa9c2f7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[442ea3aa-6c8e-40fc-8ffc-cc33ead48b5a]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Flushing IO for device /dev/sdc {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f48117-68a4-4707-8767-de4a6a39e4c5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb24436-e89e-4f89-bf78-d0951e0e1b1c]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c8a930-8f21-4336-b32e-737410ff20d9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b7d9e0-0d83-4fe1-9d9b-88572a16122c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047, portal: 172.16.0.220,3260]
Jul 25 17:12:19 user nova-compute[70659]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047, portal: 172.16.0.220,3260] successful.
Jul 25 17:12:19 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e49c5b-ccbf-4d62-aa80-f3cb706d8047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7f1471-9747-4a1f-a159-4fdefb922aa3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] <== disconnect_volume: return (292ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:12:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:12:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-309bf745-7a24-455f-b4f6-e2326926e0c0 req-0ae7daec-7691-4409-ae69-5e237ac11ccd service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:12:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-309bf745-7a24-455f-b4f6-e2326926e0c0 req-0ae7daec-7691-4409-ae69-5e237ac11ccd service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing instance network info cache due to event network-changed-888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:12:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-309bf745-7a24-455f-b4f6-e2326926e0c0 req-0ae7daec-7691-4409-ae69-5e237ac11ccd service nova] Acquiring lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:12:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-309bf745-7a24-455f-b4f6-e2326926e0c0 req-0ae7daec-7691-4409-ae69-5e237ac11ccd service nova] Acquired lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:12:20 user nova-compute[70659]: DEBUG nova.network.neutron [req-309bf745-7a24-455f-b4f6-e2326926e0c0 req-0ae7daec-7691-4409-ae69-5e237ac11ccd service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Refreshing network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:12:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:20 user nova-compute[70659]: DEBUG nova.objects.instance [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'flavor' on Instance uuid f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:12:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-cead1644-0d35-444e-b625-ecfafef3cc8b tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.605s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:12:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-309bf745-7a24-455f-b4f6-e2326926e0c0 req-0ae7daec-7691-4409-ae69-5e237ac11ccd service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updated VIF entry in instance network info cache for port 888087ef-4c90-4ce4-817f-b1124f30e30d. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:12:21 user nova-compute[70659]: DEBUG nova.network.neutron [req-309bf745-7a24-455f-b4f6-e2326926e0c0 req-0ae7daec-7691-4409-ae69-5e237ac11ccd service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating instance_info_cache with network_info: [{"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:12:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-309bf745-7a24-455f-b4f6-e2326926e0c0 req-0ae7daec-7691-4409-ae69-5e237ac11ccd service nova] Releasing lock "refresh_cache-f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:12:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:12:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:12:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:12:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:12:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:12:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:12:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:12:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:12:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:06 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:13:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:07 user nova-compute[70659]: INFO nova.compute.manager [None req-feb389ce-a8c2-4a7e-97c8-6f2cc3c12418 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Get console output
Jul 25 17:13:07 user nova-compute[70659]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 940f2d84-8561-4345-a291-819dc67abba8 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 659f3aeb-24fd-435e-a33e-85032edfd446 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "612d6677-e182-4337-a33e-622efb364df2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "940f2d84-8561-4345-a291-819dc67abba8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "612d6677-e182-4337-a33e-622efb364df2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "940f2d84-8561-4345-a291-819dc67abba8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:10 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:13:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:13:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=25.175621032714844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 940f2d84-8561-4345-a291-819dc67abba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 659f3aeb-24fd-435e-a33e-85032edfd446 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d37c53e1-18e7-4812-a214-dbffc71e0216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:13:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:13:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:13:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:13:12 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:13:12 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:13:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating instance_info_cache with network_info: [{"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:13:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-612d6677-e182-4337-a33e-622efb364df2" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:13:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:13:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:14 user nova-compute[70659]: INFO nova.compute.manager [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Terminating instance
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-40cb7374-195b-4f52-8d85-ecaaa4de02f0 req-6e204d7d-ddab-4bb3-8050-945f76302463 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-unplugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-40cb7374-195b-4f52-8d85-ecaaa4de02f0 req-6e204d7d-ddab-4bb3-8050-945f76302463 service nova] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-40cb7374-195b-4f52-8d85-ecaaa4de02f0 req-6e204d7d-ddab-4bb3-8050-945f76302463 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-40cb7374-195b-4f52-8d85-ecaaa4de02f0 req-6e204d7d-ddab-4bb3-8050-945f76302463 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-40cb7374-195b-4f52-8d85-ecaaa4de02f0 req-6e204d7d-ddab-4bb3-8050-945f76302463 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] No waiting events found dispatching network-vif-unplugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-40cb7374-195b-4f52-8d85-ecaaa4de02f0 req-6e204d7d-ddab-4bb3-8050-945f76302463 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-unplugged-888087ef-4c90-4ce4-817f-b1124f30e30d for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:13:14 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Instance destroyed successfully.
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lazy-loading 'resources' on Instance uuid f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-228367904',display_name='tempest-TestMinimumBasicScenario-server-228367904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-228367904',id=41,image_ref='49aad436-4f88-4981-b3cd-beb4d0611b7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9WDtZeeLTx+modBMIP61zVQZ5B0mDN2r/grcbY70BtoNCHsupI0OcrJ5/Oi7vVQ1VbKZKaw/ZSrUAQ7FuL5Q3NoS+sKWz0TfWA9ekUquEwVskfqDtCbboFYqgDul2FQw==',key_name='tempest-TestMinimumBasicScenario-186873782',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:08:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='775d6e7c342a492f815f2c68c62b291a',ramdisk_id='',reservation_id='r-uwh4ohni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='49aad436-4f88-4981-b3cd-beb4d0611b7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-866741703',owner_user_name='tempest-TestMinimumBasicScenario-866741703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:10:34Z,user_data=None,user_id='b14f37927ee848b890ec02b3068251f3',uuid=f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converting VIF {"id": "888087ef-4c90-4ce4-817f-b1124f30e30d", "address": "fa:16:3e:fc:fa:91", "network": {"id": "dba75ca4-7d06-4684-8dca-c7cad3960fd4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1731380928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "775d6e7c342a492f815f2c68c62b291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888087ef-4c", "ovs_interfaceid": "888087ef-4c90-4ce4-817f-b1124f30e30d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:fa:91,bridge_name='br-int',has_traffic_filtering=True,id=888087ef-4c90-4ce4-817f-b1124f30e30d,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888087ef-4c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG os_vif [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:fa:91,bridge_name='br-int',has_traffic_filtering=True,id=888087ef-4c90-4ce4-817f-b1124f30e30d,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888087ef-4c') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap888087ef-4c, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:14 user nova-compute[70659]: INFO os_vif [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:fa:91,bridge_name='br-int',has_traffic_filtering=True,id=888087ef-4c90-4ce4-817f-b1124f30e30d,network=Network(dba75ca4-7d06-4684-8dca-c7cad3960fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888087ef-4c')
Jul 25 17:13:14 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Deleting instance files /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0_del
Jul 25 17:13:14 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Deletion of /opt/stack/data/nova/instances/f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0_del complete
Jul 25 17:13:14 user nova-compute[70659]: INFO nova.compute.manager [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 25 17:13:14 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:13:14 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:13:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:13:15 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:13:15 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Took 0.65 seconds to deallocate network for instance.
Jul 25 17:13:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-9aeef30d-311e-4aab-852d-d307e04b72d9 req-068754e9-4c8a-40c4-9945-1d8aa9492245 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-deleted-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:13:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:15 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:13:15 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:13:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:15 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Deleted allocations for instance f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0
Jul 25 17:13:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b353c622-7a8d-4927-a382-e9e8ebdc9a4d tempest-TestMinimumBasicScenario-866741703 tempest-TestMinimumBasicScenario-866741703-project-member] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.966s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-f76a3668-1fd7-46fa-8876-d576561e9510 req-90683d4c-2a0a-456c-8226-41b317c06f22 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f76a3668-1fd7-46fa-8876-d576561e9510 req-90683d4c-2a0a-456c-8226-41b317c06f22 service nova] Acquiring lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f76a3668-1fd7-46fa-8876-d576561e9510 req-90683d4c-2a0a-456c-8226-41b317c06f22 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-f76a3668-1fd7-46fa-8876-d576561e9510 req-90683d4c-2a0a-456c-8226-41b317c06f22 service nova] Lock "f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-f76a3668-1fd7-46fa-8876-d576561e9510 req-90683d4c-2a0a-456c-8226-41b317c06f22 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] No waiting events found dispatching network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:13:16 user nova-compute[70659]: WARNING nova.compute.manager [req-f76a3668-1fd7-46fa-8876-d576561e9510 req-90683d4c-2a0a-456c-8226-41b317c06f22 service nova] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Received unexpected event network-vif-plugged-888087ef-4c90-4ce4-817f-b1124f30e30d for instance with vm_state deleted and task_state None.
Jul 25 17:13:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:13:16 user nova-compute[70659]: INFO nova.compute.claims [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Claim successful on node user
Jul 25 17:13:16 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:13:16 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.network.neutron [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:13:17 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.policy [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71c2ae08dbdc4cb39c8b19b04cf0f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd36eec8cf4442a85d605df4f9346b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:13:17 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Creating image(s)
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "/opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "/opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "/opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk 1073741824" returned: 0 in 0.046s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.129s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Cannot resize image /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'migration_context' on Instance uuid 0342c9d7-fe5c-4fd8-919b-3a07dc505713 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Ensure instance console log exists: /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:17 user nova-compute[70659]: DEBUG nova.network.neutron [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Successfully created port: 14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:13:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Successfully updated port: 14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:13:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:13:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquired lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:13:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:13:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-3b623708-7dd4-4977-acae-045d44d53390 req-57a0ffa3-7e34-421f-9387-8e6e22ed6a05 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-changed-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:13:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-3b623708-7dd4-4977-acae-045d44d53390 req-57a0ffa3-7e34-421f-9387-8e6e22ed6a05 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Refreshing instance network info cache due to event network-changed-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:13:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3b623708-7dd4-4977-acae-045d44d53390 req-57a0ffa3-7e34-421f-9387-8e6e22ed6a05 service nova] Acquiring lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:13:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.network.neutron [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updating instance_info_cache with network_info: [{"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Releasing lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Instance network_info: |[{"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3b623708-7dd4-4977-acae-045d44d53390 req-57a0ffa3-7e34-421f-9387-8e6e22ed6a05 service nova] Acquired lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-3b623708-7dd4-4977-acae-045d44d53390 req-57a0ffa3-7e34-421f-9387-8e6e22ed6a05 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Refreshing network info cache for port 14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Start _get_guest_xml network_info=[{"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:13:19 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:13:19 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-684059401',display_name='tempest-TestStampPattern-server-684059401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-684059401',id=44,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOOlRrRN0KR8cIS6x0jll4OvcwrbmMAOMg1oZoyhryjalnx73JWUBSS4sKhMJusonzt8duDEurlo6TgbynL0NG1ofMvVQwRJZ0c0JffXN2APhhi/W19pK3O3reUHdkO2A==',key_name='tempest-TestStampPattern-1951316000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fd36eec8cf4442a85d605df4f9346b4',ramdisk_id='',reservation_id='r-ioeamwar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1207444888',owner_user_name='tempest-TestStampPattern-1207444888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:13:17Z,user_data=None,user_id='71c2ae08dbdc4cb39c8b19b04cf0f73a',uuid=0342c9d7-fe5c-4fd8-919b-3a07dc505713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converting VIF {"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:55:c2,bridge_name='br-int',has_traffic_filtering=True,id=14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d8ddf7-e9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.objects.instance [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'pci_devices' on Instance uuid 0342c9d7-fe5c-4fd8-919b-3a07dc505713 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:13:19 user nova-compute[70659]:   <uuid>0342c9d7-fe5c-4fd8-919b-3a07dc505713</uuid>
Jul 25 17:13:19 user nova-compute[70659]:   <name>instance-0000002c</name>
Jul 25 17:13:19 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:13:19 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:13:19 user nova-compute[70659]:   <metadata>
Jul 25 17:13:19 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:13:19 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:13:19 user nova-compute[70659]:       <nova:name>tempest-TestStampPattern-server-684059401</nova:name>
Jul 25 17:13:19 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:13:19</nova:creationTime>
Jul 25 17:13:19 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:13:19 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:13:19 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:13:19 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:13:19 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:13:19 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:13:19 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:13:19 user nova-compute[70659]:       <nova:owner>
Jul 25 17:13:19 user nova-compute[70659]:         <nova:user uuid="71c2ae08dbdc4cb39c8b19b04cf0f73a">tempest-TestStampPattern-1207444888-project-member</nova:user>
Jul 25 17:13:19 user nova-compute[70659]:         <nova:project uuid="8fd36eec8cf4442a85d605df4f9346b4">tempest-TestStampPattern-1207444888</nova:project>
Jul 25 17:13:19 user nova-compute[70659]:       </nova:owner>
Jul 25 17:13:19 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:13:19 user nova-compute[70659]:       <nova:ports>
Jul 25 17:13:19 user nova-compute[70659]:         <nova:port uuid="14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb">
Jul 25 17:13:19 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 17:13:19 user nova-compute[70659]:         </nova:port>
Jul 25 17:13:19 user nova-compute[70659]:       </nova:ports>
Jul 25 17:13:19 user nova-compute[70659]:     </nova:instance>
Jul 25 17:13:19 user nova-compute[70659]:   </metadata>
Jul 25 17:13:19 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:13:19 user nova-compute[70659]:     <system>
Jul 25 17:13:19 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:13:19 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:13:19 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:13:19 user nova-compute[70659]:       <entry name="serial">0342c9d7-fe5c-4fd8-919b-3a07dc505713</entry>
Jul 25 17:13:19 user nova-compute[70659]:       <entry name="uuid">0342c9d7-fe5c-4fd8-919b-3a07dc505713</entry>
Jul 25 17:13:19 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:13:19 user nova-compute[70659]:     </system>
Jul 25 17:13:19 user nova-compute[70659]:   </sysinfo>
Jul 25 17:13:19 user nova-compute[70659]:   <os>
Jul 25 17:13:19 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:13:19 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:13:19 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:13:19 user nova-compute[70659]:   </os>
Jul 25 17:13:19 user nova-compute[70659]:   <features>
Jul 25 17:13:19 user nova-compute[70659]:     <acpi/>
Jul 25 17:13:19 user nova-compute[70659]:     <apic/>
Jul 25 17:13:19 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:13:19 user nova-compute[70659]:   </features>
Jul 25 17:13:19 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:13:19 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:13:19 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:13:19 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:13:19 user nova-compute[70659]:   </clock>
Jul 25 17:13:19 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:13:19 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:13:19 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:13:19 user nova-compute[70659]:   </cpu>
Jul 25 17:13:19 user nova-compute[70659]:   <devices>
Jul 25 17:13:19 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:13:19 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:13:19 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk"/>
Jul 25 17:13:19 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:13:19 user nova-compute[70659]:     </disk>
Jul 25 17:13:19 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:13:19 user nova-compute[70659]:       <mac address="fa:16:3e:d6:55:c2"/>
Jul 25 17:13:19 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:13:19 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:13:19 user nova-compute[70659]:       <target dev="tap14d8ddf7-e9"/>
Jul 25 17:13:19 user nova-compute[70659]:     </interface>
Jul 25 17:13:19 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:13:19 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/console.log" append="off"/>
Jul 25 17:13:19 user nova-compute[70659]:     </serial>
Jul 25 17:13:19 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:13:19 user nova-compute[70659]:     <video>
Jul 25 17:13:19 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:13:19 user nova-compute[70659]:     </video>
Jul 25 17:13:19 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:13:19 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:13:19 user nova-compute[70659]:     </rng>
Jul 25 17:13:19 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:13:19 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:13:19 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:13:19 user nova-compute[70659]:     </memballoon>
Jul 25 17:13:19 user nova-compute[70659]:   </devices>
Jul 25 17:13:19 user nova-compute[70659]: </domain>
Jul 25 17:13:19 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-684059401',display_name='tempest-TestStampPattern-server-684059401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-684059401',id=44,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOOlRrRN0KR8cIS6x0jll4OvcwrbmMAOMg1oZoyhryjalnx73JWUBSS4sKhMJusonzt8duDEurlo6TgbynL0NG1ofMvVQwRJZ0c0JffXN2APhhi/W19pK3O3reUHdkO2A==',key_name='tempest-TestStampPattern-1951316000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fd36eec8cf4442a85d605df4f9346b4',ramdisk_id='',reservation_id='r-ioeamwar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1207444888',owner_user_name='tempest-TestStampPattern-1207444888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:13:17Z,user_data=None,user_id='71c2ae08dbdc4cb39c8b19b04cf0f73a',uuid=0342c9d7-fe5c-4fd8-919b-3a07dc505713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converting VIF {"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:55:c2,bridge_name='br-int',has_traffic_filtering=True,id=14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d8ddf7-e9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG os_vif [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:55:c2,bridge_name='br-int',has_traffic_filtering=True,id=14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d8ddf7-e9') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14d8ddf7-e9, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14d8ddf7-e9, col_values=(('external_ids', {'iface-id': '14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:55:c2', 'vm-uuid': '0342c9d7-fe5c-4fd8-919b-3a07dc505713'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:19 user nova-compute[70659]: INFO os_vif [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:55:c2,bridge_name='br-int',has_traffic_filtering=True,id=14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d8ddf7-e9')
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No VIF found with MAC fa:16:3e:d6:55:c2, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-3b623708-7dd4-4977-acae-045d44d53390 req-57a0ffa3-7e34-421f-9387-8e6e22ed6a05 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updated VIF entry in instance network info cache for port 14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-3b623708-7dd4-4977-acae-045d44d53390 req-57a0ffa3-7e34-421f-9387-8e6e22ed6a05 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updating instance_info_cache with network_info: [{"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:13:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3b623708-7dd4-4977-acae-045d44d53390 req-57a0ffa3-7e34-421f-9387-8e6e22ed6a05 service nova] Releasing lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:13:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-bf9f0241-68f1-4483-9c76-3590a031736a req-328c5f2c-7b45-4a04-b6e2-10aa23f783e5 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:13:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bf9f0241-68f1-4483-9c76-3590a031736a req-328c5f2c-7b45-4a04-b6e2-10aa23f783e5 service nova] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bf9f0241-68f1-4483-9c76-3590a031736a req-328c5f2c-7b45-4a04-b6e2-10aa23f783e5 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bf9f0241-68f1-4483-9c76-3590a031736a req-328c5f2c-7b45-4a04-b6e2-10aa23f783e5 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:20 user nova-compute[70659]: DEBUG nova.compute.manager [req-bf9f0241-68f1-4483-9c76-3590a031736a req-328c5f2c-7b45-4a04-b6e2-10aa23f783e5 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] No waiting events found dispatching network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:13:20 user nova-compute[70659]: WARNING nova.compute.manager [req-bf9f0241-68f1-4483-9c76-3590a031736a req-328c5f2c-7b45-4a04-b6e2-10aa23f783e5 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received unexpected event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb for instance with vm_state building and task_state spawning.
Jul 25 17:13:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305202.7438595, 0342c9d7-fe5c-4fd8-919b-3a07dc505713 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:13:22 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] VM Resumed (Lifecycle Event)
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] No waiting events found dispatching network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:13:22 user nova-compute[70659]: WARNING nova.compute.manager [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received unexpected event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb for instance with vm_state building and task_state spawning.
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received event network-changed-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Refreshing instance network info cache due to event network-changed-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] Acquiring lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] Acquired lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.network.neutron [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Refreshing network info cache for port c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:13:22 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Instance spawned successfully.
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:13:22 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305202.7449605, 0342c9d7-fe5c-4fd8-919b-3a07dc505713 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:13:22 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] VM Started (Lifecycle Event)
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:13:22 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:13:22 user nova-compute[70659]: INFO nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Took 5.57 seconds to spawn the instance on the hypervisor.
Jul 25 17:13:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:13:22 user nova-compute[70659]: INFO nova.compute.manager [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Took 6.27 seconds to build instance.
Jul 25 17:13:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-5ec677c3-8d5d-4698-8b6d-f387f02e9c4d tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.364s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Updated VIF entry in instance network info cache for port c2f390eb-7a55-4f9e-b68b-2d26d13cf23f. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:13:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Updating instance_info_cache with network_info: [{"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:13:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0be56fb5-54f0-464c-b9bb-f504c2a31d8a req-6400d7fb-f43e-4d2b-8860-0b85c135aec2 service nova] Releasing lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:13:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG nova.objects.instance [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'flavor' on Instance uuid 659f3aeb-24fd-435e-a33e-85032edfd446 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:25 user nova-compute[70659]: INFO nova.compute.manager [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Attaching volume 6468bbfa-edb9-4dd5-84f3-96003ee617bb to /dev/vdb
Jul 25 17:13:25 user nova-compute[70659]: DEBUG os_brick.utils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e2899-7b78-4987-bd57-458431706bd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdfba48-2b48-4b59-9ea9-4b013a1ab9a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6173eaf7-79ee-45d5-b876-b1d0b337e683]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b999f7d8-608c-4bd7-b059-22b2a58be83c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:13:25 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:13:25 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[29593202-4dbd-4393-a443-ff5eecd5ad22]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG os_brick.utils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:13:25 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Updating existing volume attachment record: a6ce0362-32e6-46d2-bc92-a5cd9825a82b {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:13:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:29 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305194.8594959, f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:13:29 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] VM Stopped (Lifecycle Event)
Jul 25 17:13:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-72ceee6d-06cf-4118-8b57-04478fe9e73b None None] [instance: f18a7b5c-0247-4d60-9f4f-e4a945d7e8e0] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIbHmQfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:13:32 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:13:32 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:13:32 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a91e4a6-9679-4b92-ad9a-885833070ca2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:13:32 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1961c79e-e140-411a-a81b-710cfbb15dba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb] added
Jul 25 17:13:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a57505-efec-4cc1-83ac-4daff877f45c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5bf64e-a795-4812-9399-cf6f0e4d168d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIbHmQfB {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIbHmQfB" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[81234fe0-f859-458a-beb4-103ef698b64c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qIbHmQfB'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fbd308-d87f-482c-b2f0-da85c82d4eae]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f1a49f-c7af-479d-98b9-adef008fdf2b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:13:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:13:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e4b16e-45f4-4a5e-bc71-b340109a1b5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb, portal: 172.16.0.220,3260]
Jul 25 17:13:32 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb, portal: 172.16.0.220,3260] successful.
Jul 25 17:13:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e689d9-f824-488d-943f-6aa76f67612f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[588577af-c81b-4ed2-ad6a-9271beac5e8f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:13:32 user nova-compute[70659]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb (non-flash)
Jul 25 17:13:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:13:32 user nova-compute[70659]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb (non-flash)
Jul 25 17:13:32 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe4e99-b849-45ab-82db-3be1f9ad2b1f]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:32 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:13:33 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:13:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIbHmQfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:13:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:13:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23731323466303037', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:13:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731323466303037', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:13:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'flavor' on Instance uuid 659f3aeb-24fd-435e-a33e-85032edfd446 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:13:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:13:33 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:13:33 user nova-compute[70659]:   <source dev="/dev/sdc"/>
Jul 25 17:13:33 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:13:33 user nova-compute[70659]:   <serial>6468bbfa-edb9-4dd5-84f3-96003ee617bb</serial>
Jul 25 17:13:33 user nova-compute[70659]: </disk>
Jul 25 17:13:33 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:13:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:13:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:13:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] No VIF found with MAC fa:16:3e:b2:89:91, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:13:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-374faf89-f790-46bc-b442-45b528bbb7f3 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.708s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:13:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:13:35 user nova-compute[70659]: INFO nova.compute.manager [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Detaching volume 6468bbfa-edb9-4dd5-84f3-96003ee617bb
Jul 25 17:13:35 user nova-compute[70659]: INFO nova.virt.block_device [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Attempting to driver detach volume 6468bbfa-edb9-4dd5-84f3-96003ee617bb from mountpoint /dev/vdb
Jul 25 17:13:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Attempting to detach device vdb from instance 659f3aeb-24fd-435e-a33e-85032edfd446 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:13:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:13:35 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:13:35 user nova-compute[70659]:   <source dev="/dev/sdc"/>
Jul 25 17:13:35 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:13:35 user nova-compute[70659]:   <serial>6468bbfa-edb9-4dd5-84f3-96003ee617bb</serial>
Jul 25 17:13:35 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:13:35 user nova-compute[70659]: </disk>
Jul 25 17:13:35 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:13:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully detached device vdb from instance 659f3aeb-24fd-435e-a33e-85032edfd446 from the persistent domain config.
Jul 25 17:13:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 659f3aeb-24fd-435e-a33e-85032edfd446 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:13:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:13:35 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:13:35 user nova-compute[70659]:   <source dev="/dev/sdc"/>
Jul 25 17:13:35 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:13:35 user nova-compute[70659]:   <serial>6468bbfa-edb9-4dd5-84f3-96003ee617bb</serial>
Jul 25 17:13:35 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:13:35 user nova-compute[70659]: </disk>
Jul 25 17:13:35 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690305216.2034912, 659f3aeb-24fd-435e-a33e-85032edfd446 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 659f3aeb-24fd-435e-a33e-85032edfd446 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:13:36 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully detached device vdb from instance 659f3aeb-24fd-435e-a33e-85032edfd446 from the live domain config.
Jul 25 17:13:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIbHmQfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:13:36 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0bdc51-7e27-424e-bcf5-289a249a8a79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[51554740-82dd-4cc2-bd61-9f4a541b0257]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:13:36 user nova-compute[70659]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb (non-flash)
Jul 25 17:13:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:13:36 user nova-compute[70659]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb (non-flash)
Jul 25 17:13:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30503a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb'): ({'sdc'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Removing single pathed devices sdc {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d9b9e-bf20-4daf-ae4e-15c6adf1b113]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97c20f-ba1a-4e6f-a691-2ed52d375f68]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Flushing IO for device /dev/sdc {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6864ab8e-8d23-4003-8122-5d9e3262bfb3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[326f7bbe-b650-4518-8d08-226f0be3469d]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9623bd7a-a1e8-40ca-82d1-f7c291fe05a8]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b3e8f-e09f-4bcb-a4db-31de23dc4e73]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb, portal: 172.16.0.220,3260]
Jul 25 17:13:36 user nova-compute[70659]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb, portal: 172.16.0.220,3260] successful.
Jul 25 17:13:36 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6468bbfa-edb9-4dd5-84f3-96003ee617bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fe504a-135e-44e4-bae9-4836a2feb4e7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] <== disconnect_volume: return (265ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:13:36 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:13:37 user nova-compute[70659]: DEBUG nova.objects.instance [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'flavor' on Instance uuid 659f3aeb-24fd-435e-a33e-85032edfd446 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:13:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-6140f0c6-900e-4386-89bd-b1bfe3b3b2d6 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.584s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:13:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-168428d0-13d6-4548-a0e3-86ba50d2e6d8 req-62c0f74b-0f1e-4889-890c-3e1520e373e5 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-changed-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:13:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-168428d0-13d6-4548-a0e3-86ba50d2e6d8 req-62c0f74b-0f1e-4889-890c-3e1520e373e5 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Refreshing instance network info cache due to event network-changed-a53e8969-1594-4568-aeb6-80263ee2cf1a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:13:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-168428d0-13d6-4548-a0e3-86ba50d2e6d8 req-62c0f74b-0f1e-4889-890c-3e1520e373e5 service nova] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:13:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-168428d0-13d6-4548-a0e3-86ba50d2e6d8 req-62c0f74b-0f1e-4889-890c-3e1520e373e5 service nova] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:13:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-168428d0-13d6-4548-a0e3-86ba50d2e6d8 req-62c0f74b-0f1e-4889-890c-3e1520e373e5 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Refreshing network info cache for port a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:13:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:13:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] instance snapshotting
Jul 25 17:13:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-168428d0-13d6-4548-a0e3-86ba50d2e6d8 req-62c0f74b-0f1e-4889-890c-3e1520e373e5 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updated VIF entry in instance network info cache for port a53e8969-1594-4568-aeb6-80263ee2cf1a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:13:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-168428d0-13d6-4548-a0e3-86ba50d2e6d8 req-62c0f74b-0f1e-4889-890c-3e1520e373e5 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:13:38 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Beginning live snapshot process
Jul 25 17:13:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-168428d0-13d6-4548-a0e3-86ba50d2e6d8 req-62c0f74b-0f1e-4889-890c-3e1520e373e5 service nova] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:13:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json -f qcow2 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json -f qcow2 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:38 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn3x9mwi7/8b04a8b4bfe942c9aac7274613397e2c.delta 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn3x9mwi7/8b04a8b4bfe942c9aac7274613397e2c.delta 1073741824" returned: 0 in 0.052s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:39 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 17:13:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 17:13:40 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 17:13:40 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 17:13:40 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 17:13:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn3x9mwi7/8b04a8b4bfe942c9aac7274613397e2c.delta /opt/stack/data/nova/instances/snapshots/tmpn3x9mwi7/8b04a8b4bfe942c9aac7274613397e2c {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:13:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn3x9mwi7/8b04a8b4bfe942c9aac7274613397e2c.delta /opt/stack/data/nova/instances/snapshots/tmpn3x9mwi7/8b04a8b4bfe942c9aac7274613397e2c" returned: 0 in 0.311s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:13:40 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Snapshot extracted, beginning image upload
Jul 25 17:13:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:42 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Snapshot image upload complete
Jul 25 17:13:42 user nova-compute[70659]: INFO nova.compute.manager [None req-f6099015-60a2-421d-855b-250580a7a10b tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Took 4.54 seconds to snapshot the instance on the hypervisor.
Jul 25 17:13:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:13:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:14:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:06 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:07 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:07 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:08 user nova-compute[70659]: INFO nova.compute.manager [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Terminating instance
Jul 25 17:14:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-90ccc2b1-91ed-4a78-bb0a-2929e6f571fd req-6f9a803c-0ed7-430c-bacc-266be6499d22 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-unplugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-90ccc2b1-91ed-4a78-bb0a-2929e6f571fd req-6f9a803c-0ed7-430c-bacc-266be6499d22 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-90ccc2b1-91ed-4a78-bb0a-2929e6f571fd req-6f9a803c-0ed7-430c-bacc-266be6499d22 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-90ccc2b1-91ed-4a78-bb0a-2929e6f571fd req-6f9a803c-0ed7-430c-bacc-266be6499d22 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-90ccc2b1-91ed-4a78-bb0a-2929e6f571fd req-6f9a803c-0ed7-430c-bacc-266be6499d22 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-unplugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:14:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-90ccc2b1-91ed-4a78-bb0a-2929e6f571fd req-6f9a803c-0ed7-430c-bacc-266be6499d22 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-unplugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:14:09 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Instance destroyed successfully.
Jul 25 17:14:09 user nova-compute[70659]: DEBUG nova.objects.instance [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'resources' on Instance uuid 940f2d84-8561-4345-a291-819dc67abba8 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-997832181',display_name='tempest-ServerActionsTestOtherA-server-997832181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-997832181',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-a151piun',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:11:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=940f2d84-8561-4345-a291-819dc67abba8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "address": "fa:16:3e:80:67:ef", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182ef6f0-86", "ovs_interfaceid": "182ef6f0-865b-4e16-89c8-9b57ace1d272", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_vif [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap182ef6f0-86, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:14:09 user nova-compute[70659]: INFO os_vif [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:67:ef,bridge_name='br-int',has_traffic_filtering=True,id=182ef6f0-865b-4e16-89c8-9b57ace1d272,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182ef6f0-86')
Jul 25 17:14:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdMEbPGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:14:09 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8a6e46-86ea-49f6-8f4c-29f3cf0a9940]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6167075a-f9f8-4537-bd86-9c0943046450]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:14:09 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 (non-flash)
Jul 25 17:14:09 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd36d36050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d485c7-42e3-4178-b5c3-6d82a4dd4c7d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4d692b-5d12-4331-a852-221a71a3c872]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff8f47-6499-4f67-87d7-8b31f588e24f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2791b9-b892-4b1f-baeb-0854f4577bef]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23332376161333334', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f5c6f015', '/dev/disk/by-id/scsi-1SCST_BIOf5c6f015-327aa3346fdc2afa') {{(pid=81811) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[137d79b0-05a6-4ae6-b0a2-0519c64a1f15]: (4, None) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce1bc4b-94e2-4068-b51c-f798ea3c675c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a9a33-1615-4ac7-a71b-c780ef4bdff9]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260]
Jul 25 17:14:09 user nova-compute[70659]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98, portal: 172.16.0.220,3260] successful.
Jul 25 17:14:09 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[09231ed9-8e7e-45c3-91dc-47c615cee578]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] <== disconnect_volume: return (301ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:14:09 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Deleting instance files /opt/stack/data/nova/instances/940f2d84-8561-4345-a291-819dc67abba8_del
Jul 25 17:14:09 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Deletion of /opt/stack/data/nova/instances/940f2d84-8561-4345-a291-819dc67abba8_del complete
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: INFO nova.compute.manager [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 940f2d84-8561-4345-a291-819dc67abba8] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:14:10 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Took 0.93 seconds to deallocate network for instance.
Jul 25 17:14:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-710ef2a2-e887-4562-8f8e-1a38b979dfe3 req-351a350a-5a3a-4fca-8951-599ce825576a service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-deleted-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:14:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:14:10 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Error from libvirt while getting description of instance-00000027: [Error Code 42] Domain not found: no domain with matching uuid '940f2d84-8561-4345-a291-819dc67abba8' (instance-00000027): libvirt.libvirtError: Domain not found: no domain with matching uuid '940f2d84-8561-4345-a291-819dc67abba8' (instance-00000027)
Jul 25 17:14:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:14:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8283MB free_disk=25.155811309814453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-8cc0c5db-b12b-4d11-858d-eca9d2f86a2a req-01838a3c-5f8f-4a70-8e6b-dbccdd948d69 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8cc0c5db-b12b-4d11-858d-eca9d2f86a2a req-01838a3c-5f8f-4a70-8e6b-dbccdd948d69 service nova] Acquiring lock "940f2d84-8561-4345-a291-819dc67abba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8cc0c5db-b12b-4d11-858d-eca9d2f86a2a req-01838a3c-5f8f-4a70-8e6b-dbccdd948d69 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8cc0c5db-b12b-4d11-858d-eca9d2f86a2a req-01838a3c-5f8f-4a70-8e6b-dbccdd948d69 service nova] Lock "940f2d84-8561-4345-a291-819dc67abba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.manager [req-8cc0c5db-b12b-4d11-858d-eca9d2f86a2a req-01838a3c-5f8f-4a70-8e6b-dbccdd948d69 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] No waiting events found dispatching network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:14:11 user nova-compute[70659]: WARNING nova.compute.manager [req-8cc0c5db-b12b-4d11-858d-eca9d2f86a2a req-01838a3c-5f8f-4a70-8e6b-dbccdd948d69 service nova] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Received unexpected event network-vif-plugged-182ef6f0-865b-4e16-89c8-9b57ace1d272 for instance with vm_state active and task_state deleting.
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 612d6677-e182-4337-a33e-622efb364df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 940f2d84-8561-4345-a291-819dc67abba8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 659f3aeb-24fd-435e-a33e-85032edfd446 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d37c53e1-18e7-4812-a214-dbffc71e0216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:14:11 user nova-compute[70659]: INFO nova.compute.manager [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Took 0.74 seconds to detach 1 volumes for instance.
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Deleting volume: dad3d12e-5a7f-4a92-8ab9-8413cbee0a98 {{(pid=70659) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.052s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:11 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Deleted allocations for instance 940f2d84-8561-4345-a291-819dc67abba8
Jul 25 17:14:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c5b3ce72-e9d4-402b-8dc1-53e855e10bd4 tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "940f2d84-8561-4345-a291-819dc67abba8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.409s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:14:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:14:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:14:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:14:13 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Updating instance_info_cache with network_info: [{"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:14:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-659f3aeb-24fd-435e-a33e-85032edfd446" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:14:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:14:14 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:14:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:24 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305249.0582743, 940f2d84-8561-4345-a291-819dc67abba8 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:14:24 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 940f2d84-8561-4345-a291-819dc67abba8] VM Stopped (Lifecycle Event)
Jul 25 17:14:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1c6b5166-b0e0-4cd5-90f2-a7a1d11df1cf None None] [instance: 940f2d84-8561-4345-a291-819dc67abba8] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:14:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:14:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:14:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:14:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:14:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:26 user nova-compute[70659]: INFO nova.compute.manager [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Terminating instance
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac606afc-2e59-411a-ad76-6a7e7fe46fed req-0920a44f-35d4-4482-aafd-298b638ccb25 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received event network-vif-unplugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac606afc-2e59-411a-ad76-6a7e7fe46fed req-0920a44f-35d4-4482-aafd-298b638ccb25 service nova] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac606afc-2e59-411a-ad76-6a7e7fe46fed req-0920a44f-35d4-4482-aafd-298b638ccb25 service nova] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac606afc-2e59-411a-ad76-6a7e7fe46fed req-0920a44f-35d4-4482-aafd-298b638ccb25 service nova] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac606afc-2e59-411a-ad76-6a7e7fe46fed req-0920a44f-35d4-4482-aafd-298b638ccb25 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] No waiting events found dispatching network-vif-unplugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac606afc-2e59-411a-ad76-6a7e7fe46fed req-0920a44f-35d4-4482-aafd-298b638ccb25 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received event network-vif-unplugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:14:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Instance destroyed successfully.
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lazy-loading 'resources' on Instance uuid 659f3aeb-24fd-435e-a33e-85032edfd446 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:11:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688764387',display_name='tempest-AttachVolumeNegativeTest-server-688764387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688764387',id=42,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqLQjQLzu/j+1KMJcgXtBzd7uslsfFDvpr0Gp1L9xxcaSfs5/Hy1sokKTdRk5XtrhimK2wmokCTaYz0R3bouRgqBVFOkvYozU4+p6sweY69EsQ/wmiY+bnAHT2DRXIMDg==',key_name='tempest-keypair-308832690',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5ed4eae8755454c9e5be953e69c013a',ramdisk_id='',reservation_id='r-vysvwf6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-921778031',owner_user_name='tempest-AttachVolumeNegativeTest-921778031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:11:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e925fbb88b3e433abd27fa08a766e4e8',uuid=659f3aeb-24fd-435e-a33e-85032edfd446,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converting VIF {"id": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "address": "fa:16:3e:b2:89:91", "network": {"id": "00a213ed-5f6d-4676-8504-f6e2a05b5d34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1319457241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ed4eae8755454c9e5be953e69c013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f390eb-7a", "ovs_interfaceid": "c2f390eb-7a55-4f9e-b68b-2d26d13cf23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:89:91,bridge_name='br-int',has_traffic_filtering=True,id=c2f390eb-7a55-4f9e-b68b-2d26d13cf23f,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f390eb-7a') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG os_vif [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:89:91,bridge_name='br-int',has_traffic_filtering=True,id=c2f390eb-7a55-4f9e-b68b-2d26d13cf23f,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f390eb-7a') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2f390eb-7a, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:14:26 user nova-compute[70659]: INFO os_vif [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:89:91,bridge_name='br-int',has_traffic_filtering=True,id=c2f390eb-7a55-4f9e-b68b-2d26d13cf23f,network=Network(00a213ed-5f6d-4676-8504-f6e2a05b5d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f390eb-7a')
Jul 25 17:14:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Deleting instance files /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446_del
Jul 25 17:14:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Deletion of /opt/stack/data/nova/instances/659f3aeb-24fd-435e-a33e-85032edfd446_del complete
Jul 25 17:14:26 user nova-compute[70659]: INFO nova.compute.manager [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Took 0.83 seconds to destroy the instance on the hypervisor.
Jul 25 17:14:26 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:14:26 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:14:27 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:14:27 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Took 0.93 seconds to deallocate network for instance.
Jul 25 17:14:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-a1acbb13-674d-45c4-a087-716821e8ac97 req-b1214d05-3ca3-4beb-b7e9-951a110d8608 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received event network-vif-deleted-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:14:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:28 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:14:28 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:14:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:28 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Deleted allocations for instance 659f3aeb-24fd-435e-a33e-85032edfd446
Jul 25 17:14:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fb6ef333-2df4-43c2-bd6f-80b2dd131e44 tempest-AttachVolumeNegativeTest-921778031 tempest-AttachVolumeNegativeTest-921778031-project-member] Lock "659f3aeb-24fd-435e-a33e-85032edfd446" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.286s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-a3b74a08-410c-4875-a316-8e4566b9eaf7 req-0293adeb-fd4c-4089-92d4-780ff0479765 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received event network-vif-plugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:14:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a3b74a08-410c-4875-a316-8e4566b9eaf7 req-0293adeb-fd4c-4089-92d4-780ff0479765 service nova] Acquiring lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:14:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a3b74a08-410c-4875-a316-8e4566b9eaf7 req-0293adeb-fd4c-4089-92d4-780ff0479765 service nova] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:14:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a3b74a08-410c-4875-a316-8e4566b9eaf7 req-0293adeb-fd4c-4089-92d4-780ff0479765 service nova] Lock "659f3aeb-24fd-435e-a33e-85032edfd446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:14:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-a3b74a08-410c-4875-a316-8e4566b9eaf7 req-0293adeb-fd4c-4089-92d4-780ff0479765 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] No waiting events found dispatching network-vif-plugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:14:28 user nova-compute[70659]: WARNING nova.compute.manager [req-a3b74a08-410c-4875-a316-8e4566b9eaf7 req-0293adeb-fd4c-4089-92d4-780ff0479765 service nova] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Received unexpected event network-vif-plugged-c2f390eb-7a55-4f9e-b68b-2d26d13cf23f for instance with vm_state deleted and task_state None.
Jul 25 17:14:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:41 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305266.8298166, 659f3aeb-24fd-435e-a33e-85032edfd446 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:14:41 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] VM Stopped (Lifecycle Event)
Jul 25 17:14:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5288ac23-decd-412d-813d-2df6fa2d1f2a None None] [instance: 659f3aeb-24fd-435e-a33e-85032edfd446] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:14:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:14:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:14:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:14:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:14:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:14:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:14:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:14:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:15:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:15:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:15:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:15:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:15:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:02 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:15:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:03 user nova-compute[70659]: INFO nova.compute.manager [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Terminating instance
Jul 25 17:15:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:15:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1446b72d-4bf9-4b2a-8781-9e9acffea5b3 req-43229189-10bb-4121-a802-1668887e1906 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-unplugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1446b72d-4bf9-4b2a-8781-9e9acffea5b3 req-43229189-10bb-4121-a802-1668887e1906 service nova] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1446b72d-4bf9-4b2a-8781-9e9acffea5b3 req-43229189-10bb-4121-a802-1668887e1906 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1446b72d-4bf9-4b2a-8781-9e9acffea5b3 req-43229189-10bb-4121-a802-1668887e1906 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1446b72d-4bf9-4b2a-8781-9e9acffea5b3 req-43229189-10bb-4121-a802-1668887e1906 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] No waiting events found dispatching network-vif-unplugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-1446b72d-4bf9-4b2a-8781-9e9acffea5b3 req-43229189-10bb-4121-a802-1668887e1906 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-unplugged-2522dddf-d653-4f79-9db4-4785f9566253 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] Instance destroyed successfully.
Jul 25 17:15:04 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lazy-loading 'resources' on Instance uuid 612d6677-e182-4337-a33e-622efb364df2 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1260012504',display_name='tempest-ServerActionsTestOtherA-server-1637307971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1260012504',id=29,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6bQgH6kX9P5phZ56WsAASbv8cXrt6Rp1A1YXNNTO6xGD/MLos/aeND3HVITKiD7K6TOFAg9BD6e8s/hmqj43pFhVNDvHS1BvHuv/agGr1Ys7Ycy5XdPLEx9STcLyyiAQ==',key_name='tempest-keypair-1273481392',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77a3bf6c11a04274b5059bd9dd6be00e',ramdisk_id='',reservation_id='r-b5pqhqi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1965201562',owner_user_name='tempest-ServerActionsTestOtherA-1965201562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f29db3ae5934862b72e71e6863b46a6',uuid=612d6677-e182-4337-a33e-622efb364df2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converting VIF {"id": "2522dddf-d653-4f79-9db4-4785f9566253", "address": "fa:16:3e:a5:e2:58", "network": {"id": "cbe6f39c-f93a-471f-b0a6-4d69ab1db6df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-901800358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77a3bf6c11a04274b5059bd9dd6be00e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2522dddf-d6", "ovs_interfaceid": "2522dddf-d653-4f79-9db4-4785f9566253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG os_vif [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2522dddf-d6, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:15:04 user nova-compute[70659]: INFO os_vif [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e2:58,bridge_name='br-int',has_traffic_filtering=True,id=2522dddf-d653-4f79-9db4-4785f9566253,network=Network(cbe6f39c-f93a-471f-b0a6-4d69ab1db6df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2522dddf-d6')
Jul 25 17:15:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Deleting instance files /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2_del
Jul 25 17:15:04 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Deletion of /opt/stack/data/nova/instances/612d6677-e182-4337-a33e-622efb364df2_del complete
Jul 25 17:15:04 user nova-compute[70659]: INFO nova.compute.manager [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] [instance: 612d6677-e182-4337-a33e-622efb364df2] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 25 17:15:04 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:15:04 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:15:05 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:15:05 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] Took 0.81 seconds to deallocate network for instance.
Jul 25 17:15:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:05 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:15:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:15:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:05 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Deleted allocations for instance 612d6677-e182-4337-a33e-622efb364df2
Jul 25 17:15:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d1d9c58e-e947-4e83-b8f0-5ac27618d47f tempest-ServerActionsTestOtherA-1965201562 tempest-ServerActionsTestOtherA-1965201562-project-member] Lock "612d6677-e182-4337-a33e-622efb364df2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.124s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-edede792-9ba3-4f43-9542-ecd4a8a019f0 req-9e1fd822-6e64-46d8-8acd-eb7c8f1ace45 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:15:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-edede792-9ba3-4f43-9542-ecd4a8a019f0 req-9e1fd822-6e64-46d8-8acd-eb7c8f1ace45 service nova] Acquiring lock "612d6677-e182-4337-a33e-622efb364df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-edede792-9ba3-4f43-9542-ecd4a8a019f0 req-9e1fd822-6e64-46d8-8acd-eb7c8f1ace45 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-edede792-9ba3-4f43-9542-ecd4a8a019f0 req-9e1fd822-6e64-46d8-8acd-eb7c8f1ace45 service nova] Lock "612d6677-e182-4337-a33e-622efb364df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-edede792-9ba3-4f43-9542-ecd4a8a019f0 req-9e1fd822-6e64-46d8-8acd-eb7c8f1ace45 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] No waiting events found dispatching network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:15:06 user nova-compute[70659]: WARNING nova.compute.manager [req-edede792-9ba3-4f43-9542-ecd4a8a019f0 req-9e1fd822-6e64-46d8-8acd-eb7c8f1ace45 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received unexpected event network-vif-plugged-2522dddf-d653-4f79-9db4-4785f9566253 for instance with vm_state deleted and task_state None.
Jul 25 17:15:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-edede792-9ba3-4f43-9542-ecd4a8a019f0 req-9e1fd822-6e64-46d8-8acd-eb7c8f1ace45 service nova] [instance: 612d6677-e182-4337-a33e-622efb364df2] Received event network-vif-deleted-2522dddf-d653-4f79-9db4-4785f9566253 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:15:07 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:15:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:15:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:15:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-503db581-960b-4209-91a4-3a9701f1e8f1 req-d9c5f140-6702-417c-8560-b3a539ea3d29 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-changed-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:15:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-503db581-960b-4209-91a4-3a9701f1e8f1 req-d9c5f140-6702-417c-8560-b3a539ea3d29 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Refreshing instance network info cache due to event network-changed-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:15:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-503db581-960b-4209-91a4-3a9701f1e8f1 req-d9c5f140-6702-417c-8560-b3a539ea3d29 service nova] Acquiring lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:15:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-503db581-960b-4209-91a4-3a9701f1e8f1 req-d9c5f140-6702-417c-8560-b3a539ea3d29 service nova] Acquired lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:15:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-503db581-960b-4209-91a4-3a9701f1e8f1 req-d9c5f140-6702-417c-8560-b3a539ea3d29 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Refreshing network info cache for port 14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG nova.network.neutron [req-503db581-960b-4209-91a4-3a9701f1e8f1 req-d9c5f140-6702-417c-8560-b3a539ea3d29 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updated VIF entry in instance network info cache for port 14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG nova.network.neutron [req-503db581-960b-4209-91a4-3a9701f1e8f1 req-d9c5f140-6702-417c-8560-b3a539ea3d29 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updating instance_info_cache with network_info: [{"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG nova.objects.instance [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'flavor' on Instance uuid 0342c9d7-fe5c-4fd8-919b-3a07dc505713 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-503db581-960b-4209-91a4-3a9701f1e8f1 req-d9c5f140-6702-417c-8560-b3a539ea3d29 service nova] Releasing lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:09 user nova-compute[70659]: INFO nova.compute.manager [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Attaching volume 91dd32a1-0deb-49fe-b72b-bea3cf161e31 to /dev/vdb
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG os_brick.utils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf83556-566b-4344-9090-ed30d8545389]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3ae68-a940-4129-ad15-4fdaa377229d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d28595-87a9-4c5d-9c6f-a46763ad9f90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[493aaa64-1092-485e-a7c6-92da509fd003]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:15:09 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0462c253-c399-4167-ae1a-e0f27266ddbc]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG os_brick.utils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updating existing volume attachment record: 3fb550bc-9fa0-4193-b51a-06ccdf9fc684 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:10 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:15:10 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:15:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=25.20923614501953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d37c53e1-18e7-4812-a214-dbffc71e0216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:15:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:15:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:15:14 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:15:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:15:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:15:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:15:14 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:15:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:14 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:15:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:15:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YamsDqij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:15:15 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:15:15 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:15:15 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac0f1d2-922c-4d94-a87c-57cccc9ffacb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:15:15 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[05349317-9f6b-4b94-b966-929dab6dc96f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31] added
Jul 25 17:15:15 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d680a75-7f9f-44f0-97b0-c39b51377e35]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20696e3-a7f4-40e6-95f5-fb4874062566]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YamsDqij {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YamsDqij" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e104dc6-eb9d-4374-a5da-9e3d00b976dc]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YamsDqij'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3571a85-333a-43ff-933a-53c11604e51a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b3291-315e-4e9d-a88f-e426b2553d93]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:15:16 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:15:16 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:15:16 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 17:15:16 user nova-compute[70659]: 
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d08ce0-a6b0-4c13-9335-502531465a41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31, portal: 172.16.0.220,3260]
Jul 25 17:15:16 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31, portal: 172.16.0.220,3260] successful.
Jul 25 17:15:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf649c0-536a-4bea-bf73-723997b54960]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[76679281-3cc8-441e-8d2b-e24da566db7b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 (non-flash)
Jul 25 17:15:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 (non-flash)
Jul 25 17:15:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecbc4a6-8276-4e0e-a6d2-6e6eeb484d9d]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:16 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YamsDqij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.261s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '23033373562346361', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033373562346361', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'flavor' on Instance uuid 0342c9d7-fe5c-4fd8-919b-3a07dc505713 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:15:17 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:15:17 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:15:17 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:15:17 user nova-compute[70659]:   <serial>91dd32a1-0deb-49fe-b72b-bea3cf161e31</serial>
Jul 25 17:15:17 user nova-compute[70659]: </disk>
Jul 25 17:15:17 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No VIF found with MAC fa:16:3e:d6:55:c2, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:15:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-565fece3-64f0-4ef4-93b3-3c52a8e3ce57 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.189s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:19 user nova-compute[70659]: INFO nova.compute.manager [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Detaching volume 91dd32a1-0deb-49fe-b72b-bea3cf161e31
Jul 25 17:15:19 user nova-compute[70659]: INFO nova.virt.block_device [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Attempting to driver detach volume 91dd32a1-0deb-49fe-b72b-bea3cf161e31 from mountpoint /dev/vdb
Jul 25 17:15:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Attempting to detach device vdb from instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:15:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:15:19 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:15:19 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:15:19 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:15:19 user nova-compute[70659]:   <serial>91dd32a1-0deb-49fe-b72b-bea3cf161e31</serial>
Jul 25 17:15:19 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:15:19 user nova-compute[70659]: </disk>
Jul 25 17:15:19 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:15:19 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Successfully detached device vdb from instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 from the persistent domain config.
Jul 25 17:15:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:15:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:15:19 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:15:19 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:15:19 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:15:19 user nova-compute[70659]:   <serial>91dd32a1-0deb-49fe-b72b-bea3cf161e31</serial>
Jul 25 17:15:19 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:15:19 user nova-compute[70659]: </disk>
Jul 25 17:15:19 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:15:19 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305304.6787798, 612d6677-e182-4337-a33e-622efb364df2 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:15:19 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 612d6677-e182-4337-a33e-622efb364df2] VM Stopped (Lifecycle Event)
Jul 25 17:15:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f12b54eb-1400-4cd7-adc4-48f8d7fb009a None None] [instance: 612d6677-e182-4337-a33e-622efb364df2] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:15:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690305320.1025963, 0342c9d7-fe5c-4fd8-919b-3a07dc505713 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:15:20 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Successfully detached device vdb from instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 from the live domain config.
Jul 25 17:15:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YamsDqij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:15:20 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8afb38-1226-46f5-8595-9a9975f84882]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ed5c29-edf8-4eba-b8a2-7f4133463bec]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 (non-flash)
Jul 25 17:15:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 (non-flash)
Jul 25 17:15:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd2829b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9d4c97-74b1-4dc5-a34f-582ffb55906f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c039a11-f1bd-449d-ab1a-f0322402e535]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[33249f07-a47f-4f17-85bf-deb5569faebd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd553a52-7588-4e30-8921-44d2c8732ae2]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a266e2c-5a4d-4fcf-8257-73a62040b6e7]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2babc8d1-17d1-4f69-88ac-63ecbfb044c8]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31, portal: 172.16.0.220,3260]
Jul 25 17:15:20 user nova-compute[70659]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31, portal: 172.16.0.220,3260] successful.
Jul 25 17:15:20 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91dd32a1-0deb-49fe-b72b-bea3cf161e31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f52bba5-d81c-4e5b-a459-e30f802c7720]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] <== disconnect_volume: return (251ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:15:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:15:21 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'flavor' on Instance uuid 0342c9d7-fe5c-4fd8-919b-3a07dc505713 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ef2b5d60-bbd0-4aef-ab1d-ec6b75c64e91 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.603s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG nova.objects.instance [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'flavor' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:33 user nova-compute[70659]: INFO nova.compute.manager [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Attaching volume cfd1d9b2-260c-4232-a674-3741b88a14b6 to /dev/vdb
Jul 25 17:15:33 user nova-compute[70659]: DEBUG os_brick.utils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3119b1d6-a19d-4237-a88c-d60b949b6950]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0d5da-226b-4c85-916d-a96b2ed1d3a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bd75d7-7972-4a77-b680-b693aeb1f95e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eed265-e194-4f8a-ad0c-93e6e4acefbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:15:33 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:15:33 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd4bd2c-82fc-4551-b2ec-9f7076c1cc47]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG os_brick.utils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:15:33 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating existing volume attachment record: 426290bd-4611-4d09-a3e4-1be66717c4e4 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:15:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHYIFQvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:15:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:15:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:15:39 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[912616b5-21dd-4b7c-b3b8-6d9b97662455]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:15:39 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e801fef-a3ac-4a1e-ba3a-c19201e6cd58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6] added
Jul 25 17:15:39 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f23d227-08ba-47fd-a057-bd1bdb5afb5c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca80ce2-d8f9-473c-93b5-1fbcb3446d0c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHYIFQvb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHYIFQvb" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae22be-12c0-4cf6-a220-65ec0ab556e0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHYIFQvb'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eae2ec3-6ae7-4bca-9b55-b72647347a83]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[068e9b8f-eed0-4d09-9b45-ebe7761019a4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:15:39 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:15:39 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:15:39 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:15:39 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 17:15:39 user nova-compute[70659]: 
Jul 25 17:15:39 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb1243d-22cd-4219-b329-15051c8c4da1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6, portal: 172.16.0.220,3260]
Jul 25 17:15:40 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6, portal: 172.16.0.220,3260] successful.
Jul 25 17:15:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8d075-87c9-4d8c-a009-6d1d95c5fc2d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a1108c-d8c9-42f3-bf3c-2ac44b4b152c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:15:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:15:40 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f48ee4a-4ed1-4d55-b887-0afe6c6825ae]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:15:40 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHYIFQvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:15:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:15:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26133393265633361', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:15:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133393265633361', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:15:41 user nova-compute[70659]: DEBUG nova.objects.instance [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'flavor' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:15:41 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:15:41 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:15:41 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:15:41 user nova-compute[70659]:   <serial>cfd1d9b2-260c-4232-a674-3741b88a14b6</serial>
Jul 25 17:15:41 user nova-compute[70659]: </disk>
Jul 25 17:15:41 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:15:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:15:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:15:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] No VIF found with MAC fa:16:3e:46:76:94, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:15:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-540b9f3d-2787-4222-9379-94c6d20620df tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.490s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:42 user nova-compute[70659]: INFO nova.compute.manager [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Rescuing
Jul 25 17:15:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:15:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:15:42 user nova-compute[70659]: DEBUG nova.network.neutron [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:15:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:42 user nova-compute[70659]: DEBUG nova.network.neutron [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:15:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:15:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-8135178f-fa51-40fa-92ea-68cbe1dd6c7b req-eba0a7af-b8fd-4a31-8333-5b870cf8c51d service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8135178f-fa51-40fa-92ea-68cbe1dd6c7b req-eba0a7af-b8fd-4a31-8333-5b870cf8c51d service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8135178f-fa51-40fa-92ea-68cbe1dd6c7b req-eba0a7af-b8fd-4a31-8333-5b870cf8c51d service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8135178f-fa51-40fa-92ea-68cbe1dd6c7b req-eba0a7af-b8fd-4a31-8333-5b870cf8c51d service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG nova.compute.manager [req-8135178f-fa51-40fa-92ea-68cbe1dd6c7b req-eba0a7af-b8fd-4a31-8333-5b870cf8c51d service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:15:43 user nova-compute[70659]: WARNING nova.compute.manager [req-8135178f-fa51-40fa-92ea-68cbe1dd6c7b req-eba0a7af-b8fd-4a31-8333-5b870cf8c51d service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state active and task_state rescuing.
Jul 25 17:15:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Instance destroyed successfully.
Jul 25 17:15:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Attempting a stable device rescue
Jul 25 17:15:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70659) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Instance directory exists: not creating {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 17:15:43 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Creating image(s)
Jul 25 17:15:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'trusted_certs' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0.part --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG nova.virt.images [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] b78de489-e60d-4fd5-9893-3bfed1b50db9 was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0.part /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0.part /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0.converted" returned: 0 in 0.217s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.303s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0 --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:44 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0,backing_fmt=raw /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0,backing_fmt=raw /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue" returned: 0 in 0.050s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.objects.instance [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'migration_context' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Start _get_guest_xml network_info=[{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "vif_mac": "fa:16:3e:46:76:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b78de489-e60d-4fd5-9893-3bfed1b50db9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '426290bd-4611-4d09-a3e4-1be66717c4e4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHYIFQvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd37c53e1-18e7-4812-a214-dbffc71e0216', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfd1d9b2-260c-4232-a674-3741b88a14b6', 'serial': 'cfd1d9b2-260c-4232-a674-3741b88a14b6'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.objects.instance [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'resources' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-75cd96ad-1d20-4833-af3c-38825b9a50d9 req-d25b7b2c-57e1-44e4-bb80-8a19a4e11323 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-75cd96ad-1d20-4833-af3c-38825b9a50d9 req-d25b7b2c-57e1-44e4-bb80-8a19a4e11323 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-75cd96ad-1d20-4833-af3c-38825b9a50d9 req-d25b7b2c-57e1-44e4-bb80-8a19a4e11323 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-75cd96ad-1d20-4833-af3c-38825b9a50d9 req-d25b7b2c-57e1-44e4-bb80-8a19a4e11323 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.compute.manager [req-75cd96ad-1d20-4833-af3c-38825b9a50d9 req-d25b7b2c-57e1-44e4-bb80-8a19a4e11323 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:15:45 user nova-compute[70659]: WARNING nova.compute.manager [req-75cd96ad-1d20-4833-af3c-38825b9a50d9 req-d25b7b2c-57e1-44e4-bb80-8a19a4e11323 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state active and task_state rescuing.
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.objects.instance [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'numa_topology' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:45 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:15:45 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.objects.instance [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'vcpu_model' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHYIFQvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:15:45 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:15:45 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:15:45 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b5c7d9-db9e-49c4-8bd0-79f046c457de]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rHYIFQvb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 25 17:15:45 user nova-compute[70659]: node.name = iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6
Jul 25 17:15:45 user nova-compute[70659]: node.tpgt = -1
Jul 25 17:15:45 user nova-compute[70659]: node.startup = automatic
Jul 25 17:15:45 user nova-compute[70659]: node.leading_login = No
Jul 25 17:15:45 user nova-compute[70659]: iface.iscsi_ifacename = default
Jul 25 17:15:45 user nova-compute[70659]: iface.net_ifacename = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.ipaddress = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.prefix_len = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.hwaddress = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.transport_name = tcp
Jul 25 17:15:45 user nova-compute[70659]: iface.initiatorname = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.state = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.vlan_id = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.vlan_priority = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.vlan_state = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.iface_num = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.mtu = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.port = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.bootproto = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.subnet_mask = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.gateway = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.dhcp_alt_client_id_state = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.dhcp_alt_client_id = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.dhcp_dns = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.dhcp_learn_iqn = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.dhcp_req_vendor_id_state = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.dhcp_vendor_id_state = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.dhcp_vendor_id = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.dhcp_slp_da = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.fragmentation = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.gratuitous_arp = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.incoming_forwarding = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.tos_state = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.tos = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.ttl = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.delayed_ack = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.tcp_nagle = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.tcp_wsf_state = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.tcp_wsf = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.tcp_timer_scale = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.tcp_timestamp = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.redirect = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.def_task_mgmt_timeout = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.header_digest = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.data_digest = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.immediate_data = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.initial_r2t = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.data_seq_inorder = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.data_pdu_inorder = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.erl = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.max_receive_data_len = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.first_burst_len = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.max_outstanding_r2t = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.max_burst_len = 0
Jul 25 17:15:45 user nova-compute[70659]: iface.chap_auth = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.bidi_chap = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.strict_login_compliance = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.discovery_auth = <empty>
Jul 25 17:15:45 user nova-compute[70659]: iface.discovery_logout = <empty>
Jul 25 17:15:45 user nova-compute[70659]: node.discovery_address = <empty>
Jul 25 17:15:45 user nova-compute[70659]: node.discovery_port = 0
Jul 25 17:15:45 user nova-compute[70659]: node.discovery_type = static
Jul 25 17:15:45 user nova-compute[70659]: node.session.initial_cmdsn = 0
Jul 25 17:15:45 user nova-compute[70659]: node.session.initial_login_retry_max = 8
Jul 25 17:15:45 user nova-compute[70659]: node.session.xmit_thread_priority = -20
Jul 25 17:15:45 user nova-compute[70659]: node.session.cmds_max = 128
Jul 25 17:15:45 user nova-compute[70659]: node.session.queue_depth = 32
Jul 25 17:15:45 user nova-compute[70659]: node.session.nr_sessions = 1
Jul 25 17:15:45 user nova-compute[70659]: node.session.auth.authmethod = CHAP
Jul 25 17:15:45 user nova-compute[70659]: node.session.auth.username = rHYIFQvb
Jul 25 17:15:45 user nova-compute[70659]: node.session.auth.password = ***
Jul 25 17:15:45 user nova-compute[70659]: node.session.auth.username_in = <empty>
Jul 25 17:15:45 user nova-compute[70659]: node.session.auth.password_in = <empty>
Jul 25 17:15:45 user nova-compute[70659]: node.session.auth.chap_algs = MD5
Jul 25 17:15:45 user nova-compute[70659]: node.session.timeo.replacement_timeout = 120
Jul 25 17:15:45 user nova-compute[70659]: node.session.err_timeo.abort_timeout = 15
Jul 25 17:15:45 user nova-compute[70659]: node.session.err_timeo.lu_reset_timeout = 30
Jul 25 17:15:45 user nova-compute[70659]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 25 17:15:45 user nova-compute[70659]: node.session.err_timeo.host_reset_timeout = 60
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.FastAbort = Yes
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.InitialR2T = No
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.ImmediateData = Yes
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.FirstBurstLength = 262144
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.MaxBurstLength = 16776192
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.DefaultTime2Retain = 0
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.DefaultTime2Wait = 2
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.MaxConnections = 1
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 25 17:15:45 user nova-compute[70659]: node.session.iscsi.ERL = 0
Jul 25 17:15:45 user nova-compute[70659]: node.session.scan = manual
Jul 25 17:15:45 user nova-compute[70659]: node.session.reopen_max = 0
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].address = 172.16.0.220
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].port = 3260
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].startup = manual
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].tcp.window_size = 524288
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].tcp.type_of_service = 0
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].timeo.logout_timeout = 15
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].timeo.login_timeout = 15
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].timeo.auth_timeout = 45
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].timeo.noop_out_interval = 5
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].timeo.noop_out_timeout = 5
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].iscsi.HeaderDigest = None
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].iscsi.DataDigest = None
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].iscsi.IFMarker = No
Jul 25 17:15:45 user nova-compute[70659]: node.conn[0].iscsi.OFMarker = No
Jul 25 17:15:45 user nova-compute[70659]: # END RECORD
Jul 25 17:15:45 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.069s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[32085bff-90d6-4e2b-81c7-f45913e23f4a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[40694b85-fbfc-4598-b869-1001d3709fdf]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHYIFQvb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHYIFQvb" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[236fb195-d93b-4b9e-9b4e-0ccb19ff1748]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHYIFQvb'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c5d23e-b71b-4401-a4ae-2ade0a25500d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[97068877-aaf8-4353-99f2-80cea28539dd]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:15:45 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:15:45 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.196s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] HCTL ('33', '0', '0', 0) found on session 55 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[257c7650-12a1-4246-9e75-4ff345cc5bda]: (4, ('0 0 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Searching for a device in session 55 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHYIFQvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.222s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] <== connect_volume: return (224ms) {'type': 'block', 'scsi_wwn': '26133393265633361', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133393265633361', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-852746328',display_name='tempest-ServerStableDeviceRescueTest-server-852746328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-852746328',id=43,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz3xeqmkXz6C99ZCKhGq25Z5AkBW7ooXchDbKcT5VURn4ody3Vw+lkdLY+/R8IkYRaGlvf2GwFtzi+RnAKdGPBs1OzDVs0QC+JxyJntBwz/nWGExkzaogs55pltBTHKTg==',key_name='tempest-keypair-1452050967',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d7318af6ccc485a9a016177fad1b51d',ramdisk_id='',reservation_id='r-evgda7wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-611517675',owner_user_name='tempest-ServerStableDeviceRescueTest-611517675-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1519b2850b2413a983a498d0cecbf91',uuid=d37c53e1-18e7-4812-a214-dbffc71e0216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "vif_mac": "fa:16:3e:46:76:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Converting VIF {"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "vif_mac": "fa:16:3e:46:76:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:76:94,bridge_name='br-int',has_traffic_filtering=True,id=a53e8969-1594-4568-aeb6-80263ee2cf1a,network=Network(3200629f-794a-4fdc-a915-18ebcf190430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53e8969-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.objects.instance [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'pci_devices' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:15:45 user nova-compute[70659]:   <uuid>d37c53e1-18e7-4812-a214-dbffc71e0216</uuid>
Jul 25 17:15:45 user nova-compute[70659]:   <name>instance-0000002b</name>
Jul 25 17:15:45 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:15:45 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:15:45 user nova-compute[70659]:   <metadata>
Jul 25 17:15:45 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:15:45 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:15:45 user nova-compute[70659]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-852746328</nova:name>
Jul 25 17:15:45 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:15:45</nova:creationTime>
Jul 25 17:15:45 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:15:45 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:15:45 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:15:45 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:15:45 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:15:45 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:15:45 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:15:45 user nova-compute[70659]:       <nova:owner>
Jul 25 17:15:45 user nova-compute[70659]:         <nova:user uuid="a1519b2850b2413a983a498d0cecbf91">tempest-ServerStableDeviceRescueTest-611517675-project-member</nova:user>
Jul 25 17:15:45 user nova-compute[70659]:         <nova:project uuid="5d7318af6ccc485a9a016177fad1b51d">tempest-ServerStableDeviceRescueTest-611517675</nova:project>
Jul 25 17:15:45 user nova-compute[70659]:       </nova:owner>
Jul 25 17:15:45 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:15:45 user nova-compute[70659]:       <nova:ports>
Jul 25 17:15:45 user nova-compute[70659]:         <nova:port uuid="a53e8969-1594-4568-aeb6-80263ee2cf1a">
Jul 25 17:15:45 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 17:15:45 user nova-compute[70659]:         </nova:port>
Jul 25 17:15:45 user nova-compute[70659]:       </nova:ports>
Jul 25 17:15:45 user nova-compute[70659]:     </nova:instance>
Jul 25 17:15:45 user nova-compute[70659]:   </metadata>
Jul 25 17:15:45 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:15:45 user nova-compute[70659]:     <system>
Jul 25 17:15:45 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:15:45 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:15:45 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:15:45 user nova-compute[70659]:       <entry name="serial">d37c53e1-18e7-4812-a214-dbffc71e0216</entry>
Jul 25 17:15:45 user nova-compute[70659]:       <entry name="uuid">d37c53e1-18e7-4812-a214-dbffc71e0216</entry>
Jul 25 17:15:45 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:15:45 user nova-compute[70659]:     </system>
Jul 25 17:15:45 user nova-compute[70659]:   </sysinfo>
Jul 25 17:15:45 user nova-compute[70659]:   <os>
Jul 25 17:15:45 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:15:45 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:15:45 user nova-compute[70659]:   </os>
Jul 25 17:15:45 user nova-compute[70659]:   <features>
Jul 25 17:15:45 user nova-compute[70659]:     <acpi/>
Jul 25 17:15:45 user nova-compute[70659]:     <apic/>
Jul 25 17:15:45 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:15:45 user nova-compute[70659]:   </features>
Jul 25 17:15:45 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:15:45 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:15:45 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:15:45 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:15:45 user nova-compute[70659]:   </clock>
Jul 25 17:15:45 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:15:45 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:15:45 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:15:45 user nova-compute[70659]:   </cpu>
Jul 25 17:15:45 user nova-compute[70659]:   <devices>
Jul 25 17:15:45 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:15:45 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:15:45 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk"/>
Jul 25 17:15:45 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:15:45 user nova-compute[70659]:     </disk>
Jul 25 17:15:45 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:15:45 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:15:45 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 17:15:45 user nova-compute[70659]:       <target dev="vdb" bus="virtio"/>
Jul 25 17:15:45 user nova-compute[70659]:       <serial>cfd1d9b2-260c-4232-a674-3741b88a14b6</serial>
Jul 25 17:15:45 user nova-compute[70659]:     </disk>
Jul 25 17:15:45 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:15:45 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:15:45 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue"/>
Jul 25 17:15:45 user nova-compute[70659]:       <target dev="vdc" bus="virtio"/>
Jul 25 17:15:45 user nova-compute[70659]:       <boot order="1"/>
Jul 25 17:15:45 user nova-compute[70659]:     </disk>
Jul 25 17:15:45 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:15:45 user nova-compute[70659]:       <mac address="fa:16:3e:46:76:94"/>
Jul 25 17:15:45 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:15:45 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:15:45 user nova-compute[70659]:       <target dev="tapa53e8969-15"/>
Jul 25 17:15:45 user nova-compute[70659]:     </interface>
Jul 25 17:15:45 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:15:45 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/console.log" append="off"/>
Jul 25 17:15:45 user nova-compute[70659]:     </serial>
Jul 25 17:15:45 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:15:45 user nova-compute[70659]:     <video>
Jul 25 17:15:45 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:15:45 user nova-compute[70659]:     </video>
Jul 25 17:15:45 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:15:45 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:15:45 user nova-compute[70659]:     </rng>
Jul 25 17:15:45 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:15:45 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:15:45 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:15:45 user nova-compute[70659]:     </memballoon>
Jul 25 17:15:45 user nova-compute[70659]:   </devices>
Jul 25 17:15:45 user nova-compute[70659]: </domain>
Jul 25 17:15:45 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:15:45 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Instance destroyed successfully.
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:15:45 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] No VIF found with MAC fa:16:3e:46:76:94, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:15:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-d4905a93-93c8-4b96-b22d-843c50e545df req-1e261de3-3f42-4c78-b15d-a120e3662daf service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:15:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4905a93-93c8-4b96-b22d-843c50e545df req-1e261de3-3f42-4c78-b15d-a120e3662daf service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4905a93-93c8-4b96-b22d-843c50e545df req-1e261de3-3f42-4c78-b15d-a120e3662daf service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:47 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4905a93-93c8-4b96-b22d-843c50e545df req-1e261de3-3f42-4c78-b15d-a120e3662daf service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-d4905a93-93c8-4b96-b22d-843c50e545df req-1e261de3-3f42-4c78-b15d-a120e3662daf service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:15:47 user nova-compute[70659]: WARNING nova.compute.manager [req-d4905a93-93c8-4b96-b22d-843c50e545df req-1e261de3-3f42-4c78-b15d-a120e3662daf service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state active and task_state rescuing.
Jul 25 17:15:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-d4565a81-a189-43e4-a738-dcc99512c783 req-2794bccf-20f0-427e-8356-fae42fe37c22 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4565a81-a189-43e4-a738-dcc99512c783 req-2794bccf-20f0-427e-8356-fae42fe37c22 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4565a81-a189-43e4-a738-dcc99512c783 req-2794bccf-20f0-427e-8356-fae42fe37c22 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d4565a81-a189-43e4-a738-dcc99512c783 req-2794bccf-20f0-427e-8356-fae42fe37c22 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.compute.manager [req-d4565a81-a189-43e4-a738-dcc99512c783 req-2794bccf-20f0-427e-8356-fae42fe37c22 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:15:49 user nova-compute[70659]: WARNING nova.compute.manager [req-d4565a81-a189-43e4-a738-dcc99512c783 req-2794bccf-20f0-427e-8356-fae42fe37c22 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state active and task_state rescuing.
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for d37c53e1-18e7-4812-a214-dbffc71e0216 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305349.4387386, d37c53e1-18e7-4812-a214-dbffc71e0216 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:15:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] VM Resumed (Lifecycle Event)
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-470b9973-e486-4ee6-875a-a03c1e995509 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:15:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305349.4408484, d37c53e1-18e7-4812-a214-dbffc71e0216 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:15:49 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] VM Started (Lifecycle Event)
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:15:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:15:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:16:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:16:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:16:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:16:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:16:09 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:10 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:16:10 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:16:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=25.101688385009766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d37c53e1-18e7-4812-a214-dbffc71e0216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:16:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:11 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:11 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:11 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:11 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:16:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:16:15 user nova-compute[70659]: INFO nova.compute.manager [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] instance snapshotting
Jul 25 17:16:15 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Beginning live snapshot process
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json -f qcow2 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json -f qcow2 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json -f qcow2" returned: 0 in 0.154s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.145s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjlh0fbym/1efe7187ed5c4be2a06331f962f88a1c.delta 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjlh0fbym/1efe7187ed5c4be2a06331f962f88a1c.delta 1073741824" returned: 0 in 0.058s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:16 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 17:16:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:17 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:16:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:16:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:16:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 17:16:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70659) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 17:16:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 17:16:18 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 17:16:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjlh0fbym/1efe7187ed5c4be2a06331f962f88a1c.delta /opt/stack/data/nova/instances/snapshots/tmpjlh0fbym/1efe7187ed5c4be2a06331f962f88a1c {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:18 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjlh0fbym/1efe7187ed5c4be2a06331f962f88a1c.delta /opt/stack/data/nova/instances/snapshots/tmpjlh0fbym/1efe7187ed5c4be2a06331f962f88a1c" returned: 0 in 0.334s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Snapshot extracted, beginning image upload
Jul 25 17:16:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:21 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Snapshot image upload complete
Jul 25 17:16:21 user nova-compute[70659]: INFO nova.compute.manager [None req-39fa6336-23e5-44d2-87c4-0e805965173b tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Took 5.50 seconds to snapshot the instance on the hypervisor.
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:16:23 user nova-compute[70659]: INFO nova.compute.claims [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Claim successful on node user
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:16:23 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.policy [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71c2ae08dbdc4cb39c8b19b04cf0f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd36eec8cf4442a85d605df4f9346b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:16:23 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Creating image(s)
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "/opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "/opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319.part --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:24 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Successfully created port: 77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:16:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319.part --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:24 user nova-compute[70659]: DEBUG nova.virt.images [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] 5f528e3a-9dcf-4461-aa51-d8b0ed5f475a was qcow2, converting to raw {{(pid=70659) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 17:16:24 user nova-compute[70659]: DEBUG nova.privsep.utils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70659) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 17:16:24 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319.part /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319.converted {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319.part /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319.converted" returned: 0 in 0.470s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319.converted --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.575s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319 --force-share --output=json" returned: 0 in 0.296s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Successfully updated port: 77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319 --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:25 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319,backing_fmt=raw /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-fdfd4108-6671-431b-a215-5fe5f43910b9 req-798a3f2a-1898-47b5-bcaa-4a8ce6f8cc29 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received event network-changed-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.compute.manager [req-fdfd4108-6671-431b-a215-5fe5f43910b9 req-798a3f2a-1898-47b5-bcaa-4a8ce6f8cc29 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Refreshing instance network info cache due to event network-changed-77690cb3-b58c-49a7-af20-a9b44951bb44. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fdfd4108-6671-431b-a215-5fe5f43910b9 req-798a3f2a-1898-47b5-bcaa-4a8ce6f8cc29 service nova] Acquiring lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fdfd4108-6671-431b-a215-5fe5f43910b9 req-798a3f2a-1898-47b5-bcaa-4a8ce6f8cc29 service nova] Acquired lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.neutron [req-fdfd4108-6671-431b-a215-5fe5f43910b9 req-798a3f2a-1898-47b5-bcaa-4a8ce6f8cc29 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Refreshing network info cache for port 77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319,backing_fmt=raw /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk 1073741824" returned: 0 in 0.069s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.neutron [req-fdfd4108-6671-431b-a215-5fe5f43910b9 req-798a3f2a-1898-47b5-bcaa-4a8ce6f8cc29 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319 --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'migration_context' on Instance uuid b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Ensure instance console log exists: /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.neutron [req-fdfd4108-6671-431b-a215-5fe5f43910b9 req-798a3f2a-1898-47b5-bcaa-4a8ce6f8cc29 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-fdfd4108-6671-431b-a215-5fe5f43910b9 req-798a3f2a-1898-47b5-bcaa-4a8ce6f8cc29 service nova] Releasing lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquired lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.neutron [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Updating instance_info_cache with network_info: [{"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Releasing lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Instance network_info: |[{"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Start _get_guest_xml network_info=[{"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='958782475643770813fe519fe70771a8',container_format='bare',created_at=2023-07-25T17:16:15Z,direct_url=<?>,disk_format='qcow2',id=5f528e3a-9dcf-4461-aa51-d8b0ed5f475a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1534649267',owner='8fd36eec8cf4442a85d605df4f9346b4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T17:16:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': '5f528e3a-9dcf-4461-aa51-d8b0ed5f475a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:16:26 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:16:26 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='958782475643770813fe519fe70771a8',container_format='bare',created_at=2023-07-25T17:16:15Z,direct_url=<?>,disk_format='qcow2',id=5f528e3a-9dcf-4461-aa51-d8b0ed5f475a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1534649267',owner='8fd36eec8cf4442a85d605df4f9346b4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T17:16:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2093266478',display_name='tempest-TestStampPattern-server-2093266478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2093266478',id=45,image_ref='5f528e3a-9dcf-4461-aa51-d8b0ed5f475a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOOlRrRN0KR8cIS6x0jll4OvcwrbmMAOMg1oZoyhryjalnx73JWUBSS4sKhMJusonzt8duDEurlo6TgbynL0NG1ofMvVQwRJZ0c0JffXN2APhhi/W19pK3O3reUHdkO2A==',key_name='tempest-TestStampPattern-1951316000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fd36eec8cf4442a85d605df4f9346b4',ramdisk_id='',reservation_id='r-o1oymduy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0342c9d7-fe5c-4fd8-919b-3a07dc505713',image_min_disk='1',image_min_ram='0',image_owner_id='8fd36eec8cf4442a85d605df4f9346b4',image_owner_project_name='tempest-TestStampPattern-1207444888',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1207444888-project-member',image_user_id='71c2ae08dbdc4cb39c8b19b04cf0f73a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1207444888',owner_user_name='tempest-TestStampPattern-1207444888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:16:24Z,user_data=None,user_id='71c2ae08dbdc4cb39c8b19b04cf0f73a',uuid=b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converting VIF {"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:42,bridge_name='br-int',has_traffic_filtering=True,id=77690cb3-b58c-49a7-af20-a9b44951bb44,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77690cb3-b5') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.objects.instance [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'pci_devices' on Instance uuid b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:16:26 user nova-compute[70659]:   <uuid>b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f</uuid>
Jul 25 17:16:26 user nova-compute[70659]:   <name>instance-0000002d</name>
Jul 25 17:16:26 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:16:26 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:16:26 user nova-compute[70659]:   <metadata>
Jul 25 17:16:26 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:16:26 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:16:26 user nova-compute[70659]:       <nova:name>tempest-TestStampPattern-server-2093266478</nova:name>
Jul 25 17:16:26 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:16:26</nova:creationTime>
Jul 25 17:16:26 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:16:26 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:16:26 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:16:26 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:16:26 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:16:26 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:16:26 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:16:26 user nova-compute[70659]:       <nova:owner>
Jul 25 17:16:26 user nova-compute[70659]:         <nova:user uuid="71c2ae08dbdc4cb39c8b19b04cf0f73a">tempest-TestStampPattern-1207444888-project-member</nova:user>
Jul 25 17:16:26 user nova-compute[70659]:         <nova:project uuid="8fd36eec8cf4442a85d605df4f9346b4">tempest-TestStampPattern-1207444888</nova:project>
Jul 25 17:16:26 user nova-compute[70659]:       </nova:owner>
Jul 25 17:16:26 user nova-compute[70659]:       <nova:root type="image" uuid="5f528e3a-9dcf-4461-aa51-d8b0ed5f475a"/>
Jul 25 17:16:26 user nova-compute[70659]:       <nova:ports>
Jul 25 17:16:26 user nova-compute[70659]:         <nova:port uuid="77690cb3-b58c-49a7-af20-a9b44951bb44">
Jul 25 17:16:26 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 17:16:26 user nova-compute[70659]:         </nova:port>
Jul 25 17:16:26 user nova-compute[70659]:       </nova:ports>
Jul 25 17:16:26 user nova-compute[70659]:     </nova:instance>
Jul 25 17:16:26 user nova-compute[70659]:   </metadata>
Jul 25 17:16:26 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:16:26 user nova-compute[70659]:     <system>
Jul 25 17:16:26 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:16:26 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:16:26 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:16:26 user nova-compute[70659]:       <entry name="serial">b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f</entry>
Jul 25 17:16:26 user nova-compute[70659]:       <entry name="uuid">b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f</entry>
Jul 25 17:16:26 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:16:26 user nova-compute[70659]:     </system>
Jul 25 17:16:26 user nova-compute[70659]:   </sysinfo>
Jul 25 17:16:26 user nova-compute[70659]:   <os>
Jul 25 17:16:26 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:16:26 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:16:26 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:16:26 user nova-compute[70659]:   </os>
Jul 25 17:16:26 user nova-compute[70659]:   <features>
Jul 25 17:16:26 user nova-compute[70659]:     <acpi/>
Jul 25 17:16:26 user nova-compute[70659]:     <apic/>
Jul 25 17:16:26 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:16:26 user nova-compute[70659]:   </features>
Jul 25 17:16:26 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:16:26 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:16:26 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:16:26 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:16:26 user nova-compute[70659]:   </clock>
Jul 25 17:16:26 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:16:26 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:16:26 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:16:26 user nova-compute[70659]:   </cpu>
Jul 25 17:16:26 user nova-compute[70659]:   <devices>
Jul 25 17:16:26 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:16:26 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:16:26 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk"/>
Jul 25 17:16:26 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:16:26 user nova-compute[70659]:     </disk>
Jul 25 17:16:26 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:16:26 user nova-compute[70659]:       <mac address="fa:16:3e:30:08:42"/>
Jul 25 17:16:26 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:16:26 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:16:26 user nova-compute[70659]:       <target dev="tap77690cb3-b5"/>
Jul 25 17:16:26 user nova-compute[70659]:     </interface>
Jul 25 17:16:26 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:16:26 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/console.log" append="off"/>
Jul 25 17:16:26 user nova-compute[70659]:     </serial>
Jul 25 17:16:26 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:16:26 user nova-compute[70659]:     <video>
Jul 25 17:16:26 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:16:26 user nova-compute[70659]:     </video>
Jul 25 17:16:26 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:16:26 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:16:26 user nova-compute[70659]:     </rng>
Jul 25 17:16:26 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:16:26 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:16:26 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:16:26 user nova-compute[70659]:     </memballoon>
Jul 25 17:16:26 user nova-compute[70659]:   </devices>
Jul 25 17:16:26 user nova-compute[70659]: </domain>
Jul 25 17:16:26 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2093266478',display_name='tempest-TestStampPattern-server-2093266478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2093266478',id=45,image_ref='5f528e3a-9dcf-4461-aa51-d8b0ed5f475a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOOlRrRN0KR8cIS6x0jll4OvcwrbmMAOMg1oZoyhryjalnx73JWUBSS4sKhMJusonzt8duDEurlo6TgbynL0NG1ofMvVQwRJZ0c0JffXN2APhhi/W19pK3O3reUHdkO2A==',key_name='tempest-TestStampPattern-1951316000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fd36eec8cf4442a85d605df4f9346b4',ramdisk_id='',reservation_id='r-o1oymduy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0342c9d7-fe5c-4fd8-919b-3a07dc505713',image_min_disk='1',image_min_ram='0',image_owner_id='8fd36eec8cf4442a85d605df4f9346b4',image_owner_project_name='tempest-TestStampPattern-1207444888',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1207444888-project-member',image_user_id='71c2ae08dbdc4cb39c8b19b04cf0f73a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1207444888',owner_user_name='tempest-TestStampPattern-1207444888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:16:24Z,user_data=None,user_id='71c2ae08dbdc4cb39c8b19b04cf0f73a',uuid=b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converting VIF {"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:42,bridge_name='br-int',has_traffic_filtering=True,id=77690cb3-b58c-49a7-af20-a9b44951bb44,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77690cb3-b5') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG os_vif [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:42,bridge_name='br-int',has_traffic_filtering=True,id=77690cb3-b58c-49a7-af20-a9b44951bb44,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77690cb3-b5') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77690cb3-b5, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77690cb3-b5, col_values=(('external_ids', {'iface-id': '77690cb3-b58c-49a7-af20-a9b44951bb44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:08:42', 'vm-uuid': 'b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:26 user nova-compute[70659]: INFO os_vif [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:42,bridge_name='br-int',has_traffic_filtering=True,id=77690cb3-b58c-49a7-af20-a9b44951bb44,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77690cb3-b5')
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:16:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No VIF found with MAC fa:16:3e:30:08:42, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:16:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-0071a458-c9a7-4093-b6a3-bdb7e8c91216 req-91caa6f5-ece6-47e8-83de-102f384e82b0 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received event network-vif-plugged-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:16:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0071a458-c9a7-4093-b6a3-bdb7e8c91216 req-91caa6f5-ece6-47e8-83de-102f384e82b0 service nova] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0071a458-c9a7-4093-b6a3-bdb7e8c91216 req-91caa6f5-ece6-47e8-83de-102f384e82b0 service nova] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0071a458-c9a7-4093-b6a3-bdb7e8c91216 req-91caa6f5-ece6-47e8-83de-102f384e82b0 service nova] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:28 user nova-compute[70659]: DEBUG nova.compute.manager [req-0071a458-c9a7-4093-b6a3-bdb7e8c91216 req-91caa6f5-ece6-47e8-83de-102f384e82b0 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] No waiting events found dispatching network-vif-plugged-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:16:28 user nova-compute[70659]: WARNING nova.compute.manager [req-0071a458-c9a7-4093-b6a3-bdb7e8c91216 req-91caa6f5-ece6-47e8-83de-102f384e82b0 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received unexpected event network-vif-plugged-77690cb3-b58c-49a7-af20-a9b44951bb44 for instance with vm_state building and task_state spawning.
Jul 25 17:16:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd85a56d-7c21-42ef-aac7-180788143353 req-113b9cd5-9e40-4620-b7d6-d7f8d2253cdc service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received event network-vif-plugged-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd85a56d-7c21-42ef-aac7-180788143353 req-113b9cd5-9e40-4620-b7d6-d7f8d2253cdc service nova] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd85a56d-7c21-42ef-aac7-180788143353 req-113b9cd5-9e40-4620-b7d6-d7f8d2253cdc service nova] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-bd85a56d-7c21-42ef-aac7-180788143353 req-113b9cd5-9e40-4620-b7d6-d7f8d2253cdc service nova] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-bd85a56d-7c21-42ef-aac7-180788143353 req-113b9cd5-9e40-4620-b7d6-d7f8d2253cdc service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] No waiting events found dispatching network-vif-plugged-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:16:30 user nova-compute[70659]: WARNING nova.compute.manager [req-bd85a56d-7c21-42ef-aac7-180788143353 req-113b9cd5-9e40-4620-b7d6-d7f8d2253cdc service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received unexpected event network-vif-plugged-77690cb3-b58c-49a7-af20-a9b44951bb44 for instance with vm_state building and task_state spawning.
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305390.4951916, b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:16:30 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] VM Resumed (Lifecycle Event)
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:16:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Instance spawned successfully.
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:16:30 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305390.496923, b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:16:30 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] VM Started (Lifecycle Event)
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:16:30 user nova-compute[70659]: INFO nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Took 6.64 seconds to spawn the instance on the hypervisor.
Jul 25 17:16:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:16:30 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:16:30 user nova-compute[70659]: INFO nova.compute.manager [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Took 7.31 seconds to build instance.
Jul 25 17:16:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-fced6be8-015d-441b-992b-ce48a9c75e1c tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.407s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "96626839-75ba-4041-bd5e-4aba16288077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "96626839-75ba-4041-bd5e-4aba16288077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:16:55 user nova-compute[70659]: INFO nova.compute.claims [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Claim successful on node user
Jul 25 17:16:55 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:16:55 user nova-compute[70659]: DEBUG nova.network.neutron [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:16:55 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:16:55 user nova-compute[70659]: DEBUG nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:16:55 user nova-compute[70659]: INFO nova.virt.block_device [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Booting with volume snapshot bdb5bffd-bde1-49ba-86f8-842ef054a35c at /dev/vda
Jul 25 17:16:55 user nova-compute[70659]: DEBUG nova.policy [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80d4bea31bd94de88d07d0b7bae77086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ec6ce16624cd8af59a77456e647b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:16:56 user nova-compute[70659]: DEBUG nova.network.neutron [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Successfully created port: 6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:16:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:56 user nova-compute[70659]: DEBUG nova.network.neutron [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Successfully updated port: 6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "refresh_cache-96626839-75ba-4041-bd5e-4aba16288077" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquired lock "refresh_cache-96626839-75ba-4041-bd5e-4aba16288077" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG nova.network.neutron [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-4cc17364-2111-44d3-ad8e-1c6360c11bdb req-33c0941c-e541-47c2-aa89-9421601d57da service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received event network-changed-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG nova.compute.manager [req-4cc17364-2111-44d3-ad8e-1c6360c11bdb req-33c0941c-e541-47c2-aa89-9421601d57da service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Refreshing instance network info cache due to event network-changed-6f4f826d-bafb-41e5-9929-23a779295abc. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4cc17364-2111-44d3-ad8e-1c6360c11bdb req-33c0941c-e541-47c2-aa89-9421601d57da service nova] Acquiring lock "refresh_cache-96626839-75ba-4041-bd5e-4aba16288077" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG nova.network.neutron [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG nova.network.neutron [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Updating instance_info_cache with network_info: [{"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Releasing lock "refresh_cache-96626839-75ba-4041-bd5e-4aba16288077" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Instance network_info: |[{"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4cc17364-2111-44d3-ad8e-1c6360c11bdb req-33c0941c-e541-47c2-aa89-9421601d57da service nova] Acquired lock "refresh_cache-96626839-75ba-4041-bd5e-4aba16288077" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG nova.network.neutron [req-4cc17364-2111-44d3-ad8e-1c6360c11bdb req-33c0941c-e541-47c2-aa89-9421601d57da service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Refreshing network info cache for port 6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG nova.network.neutron [req-4cc17364-2111-44d3-ad8e-1c6360c11bdb req-33c0941c-e541-47c2-aa89-9421601d57da service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Updated VIF entry in instance network info cache for port 6f4f826d-bafb-41e5-9929-23a779295abc. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG nova.network.neutron [req-4cc17364-2111-44d3-ad8e-1c6360c11bdb req-33c0941c-e541-47c2-aa89-9421601d57da service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Updating instance_info_cache with network_info: [{"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:16:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-4cc17364-2111-44d3-ad8e-1c6360c11bdb req-33c0941c-e541-47c2-aa89-9421601d57da service nova] Releasing lock "refresh_cache-96626839-75ba-4041-bd5e-4aba16288077" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:16:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:16:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 17:16:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG os_brick.utils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b06903-5029-4b39-a32c-499c20ac0f4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c4a5c4-1516-489e-bb95-97dbb7a8f24e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b425700c-e6b6-41fa-915a-2c53bb308671]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aa3b67-da27-4f07-b24f-5cfbd774118b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:17:01 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:17:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7cf852-c737-4d4a-b62c-09feed4ccb55]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG os_brick.utils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Updating existing volume attachment record: 99f53d2a-64ba-44d8-9f7e-826a98c67669 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:17:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:17:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Creating image(s)
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Ensure instance console log exists: /opt/stack/data/nova/instances/96626839-75ba-4041-bd5e-4aba16288077/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Start _get_guest_xml network_info=[{"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '99f53d2a-64ba-44d8-9f7e-826a98c67669', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUzfdjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '96626839-75ba-4041-bd5e-4aba16288077', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5a36311-9d54-4c00-8b69-1ba49ebce478', 'serial': 'a5a36311-9d54-4c00-8b69-1ba49ebce478'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:17:07 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:17:07 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUzfdjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:17:07 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:17:07 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:17:07 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[537de3bc-fd4f-4736-a764-c72157eb9ea9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:17:07 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d164b1-70bd-40c1-b8f0-a70bfd07a7af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478] added
Jul 25 17:17:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc75d19-a0c4-4450-a83c-6b39c32da4f3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c933b32f-5d4d-4370-b83d-176576758399]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUzfdjGg {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUzfdjGg" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffc33a3-4da0-4589-aa35-14812e8aa258]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RUzfdjGg'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96d9644-54c6-48f6-b2f8-3443f69dd777]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cbfad0-07ce-4aa6-89c6-dda2f1f78214]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:17:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:17:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d617afa-216e-47ff-8ce2-77437d2ca860]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478, portal: 172.16.0.220,3260]
Jul 25 17:17:07 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478, portal: 172.16.0.220,3260] successful.
Jul 25 17:17:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:17:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9561f5ef-f72c-4071-9cb7-c872bba7b86d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de04874-bfb4-4760-8649-d4c5eb7f5fd3]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:17:08 user nova-compute[70659]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:17:08 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:17:08 user nova-compute[70659]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:17:08 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9cde34-8332-4455-a052-e45be05c9068]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:17:08 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUzfdjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26464623533653161', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464623533653161', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-204340854',display_name='tempest-TestVolumeBootPattern-server-204340854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-204340854',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-54ehvp7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:16:55Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=96626839-75ba-4041-bd5e-4aba16288077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:65:34,bridge_name='br-int',has_traffic_filtering=True,id=6f4f826d-bafb-41e5-9929-23a779295abc,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4f826d-ba') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.objects.instance [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'pci_devices' on Instance uuid 96626839-75ba-4041-bd5e-4aba16288077 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:17:09 user nova-compute[70659]:   <uuid>96626839-75ba-4041-bd5e-4aba16288077</uuid>
Jul 25 17:17:09 user nova-compute[70659]:   <name>instance-0000002e</name>
Jul 25 17:17:09 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:17:09 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:17:09 user nova-compute[70659]:   <metadata>
Jul 25 17:17:09 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:17:09 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:17:09 user nova-compute[70659]:       <nova:name>tempest-TestVolumeBootPattern-server-204340854</nova:name>
Jul 25 17:17:09 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:17:07</nova:creationTime>
Jul 25 17:17:09 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:17:09 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:17:09 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:17:09 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:17:09 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:17:09 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:17:09 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:17:09 user nova-compute[70659]:       <nova:owner>
Jul 25 17:17:09 user nova-compute[70659]:         <nova:user uuid="80d4bea31bd94de88d07d0b7bae77086">tempest-TestVolumeBootPattern-1024566986-project-member</nova:user>
Jul 25 17:17:09 user nova-compute[70659]:         <nova:project uuid="f60ec6ce16624cd8af59a77456e647b9">tempest-TestVolumeBootPattern-1024566986</nova:project>
Jul 25 17:17:09 user nova-compute[70659]:       </nova:owner>
Jul 25 17:17:09 user nova-compute[70659]:       <nova:ports>
Jul 25 17:17:09 user nova-compute[70659]:         <nova:port uuid="6f4f826d-bafb-41e5-9929-23a779295abc">
Jul 25 17:17:09 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 17:17:09 user nova-compute[70659]:         </nova:port>
Jul 25 17:17:09 user nova-compute[70659]:       </nova:ports>
Jul 25 17:17:09 user nova-compute[70659]:     </nova:instance>
Jul 25 17:17:09 user nova-compute[70659]:   </metadata>
Jul 25 17:17:09 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:17:09 user nova-compute[70659]:     <system>
Jul 25 17:17:09 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:17:09 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:17:09 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:17:09 user nova-compute[70659]:       <entry name="serial">96626839-75ba-4041-bd5e-4aba16288077</entry>
Jul 25 17:17:09 user nova-compute[70659]:       <entry name="uuid">96626839-75ba-4041-bd5e-4aba16288077</entry>
Jul 25 17:17:09 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:17:09 user nova-compute[70659]:     </system>
Jul 25 17:17:09 user nova-compute[70659]:   </sysinfo>
Jul 25 17:17:09 user nova-compute[70659]:   <os>
Jul 25 17:17:09 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:17:09 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:17:09 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:17:09 user nova-compute[70659]:   </os>
Jul 25 17:17:09 user nova-compute[70659]:   <features>
Jul 25 17:17:09 user nova-compute[70659]:     <acpi/>
Jul 25 17:17:09 user nova-compute[70659]:     <apic/>
Jul 25 17:17:09 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:17:09 user nova-compute[70659]:   </features>
Jul 25 17:17:09 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:17:09 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:17:09 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:17:09 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:17:09 user nova-compute[70659]:   </clock>
Jul 25 17:17:09 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:17:09 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:17:09 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:17:09 user nova-compute[70659]:   </cpu>
Jul 25 17:17:09 user nova-compute[70659]:   <devices>
Jul 25 17:17:09 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:17:09 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:17:09 user nova-compute[70659]:       <source dev="/dev/sdc"/>
Jul 25 17:17:09 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:17:09 user nova-compute[70659]:       <serial>a5a36311-9d54-4c00-8b69-1ba49ebce478</serial>
Jul 25 17:17:09 user nova-compute[70659]:     </disk>
Jul 25 17:17:09 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:17:09 user nova-compute[70659]:       <mac address="fa:16:3e:60:65:34"/>
Jul 25 17:17:09 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:17:09 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:17:09 user nova-compute[70659]:       <target dev="tap6f4f826d-ba"/>
Jul 25 17:17:09 user nova-compute[70659]:     </interface>
Jul 25 17:17:09 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:17:09 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/96626839-75ba-4041-bd5e-4aba16288077/console.log" append="off"/>
Jul 25 17:17:09 user nova-compute[70659]:     </serial>
Jul 25 17:17:09 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:17:09 user nova-compute[70659]:     <video>
Jul 25 17:17:09 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:17:09 user nova-compute[70659]:     </video>
Jul 25 17:17:09 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:17:09 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:17:09 user nova-compute[70659]:     </rng>
Jul 25 17:17:09 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:17:09 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:17:09 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:17:09 user nova-compute[70659]:     </memballoon>
Jul 25 17:17:09 user nova-compute[70659]:   </devices>
Jul 25 17:17:09 user nova-compute[70659]: </domain>
Jul 25 17:17:09 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-204340854',display_name='tempest-TestVolumeBootPattern-server-204340854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-204340854',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-54ehvp7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:16:55Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=96626839-75ba-4041-bd5e-4aba16288077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:65:34,bridge_name='br-int',has_traffic_filtering=True,id=6f4f826d-bafb-41e5-9929-23a779295abc,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4f826d-ba') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG os_vif [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:65:34,bridge_name='br-int',has_traffic_filtering=True,id=6f4f826d-bafb-41e5-9929-23a779295abc,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4f826d-ba') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f4f826d-ba, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f4f826d-ba, col_values=(('external_ids', {'iface-id': '6f4f826d-bafb-41e5-9929-23a779295abc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:65:34', 'vm-uuid': '96626839-75ba-4041-bd5e-4aba16288077'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:09 user nova-compute[70659]: INFO os_vif [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:65:34,bridge_name='br-int',has_traffic_filtering=True,id=6f4f826d-bafb-41e5-9929-23a779295abc,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4f826d-ba')
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No VIF found with MAC fa:16:3e:60:65:34, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:17:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-41df24b4-8092-40c8-91a6-b4aa45f6a7cd req-6f5c4972-f805-4737-9029-5b7499218ffb service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received event network-vif-plugged-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-41df24b4-8092-40c8-91a6-b4aa45f6a7cd req-6f5c4972-f805-4737-9029-5b7499218ffb service nova] Acquiring lock "96626839-75ba-4041-bd5e-4aba16288077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-41df24b4-8092-40c8-91a6-b4aa45f6a7cd req-6f5c4972-f805-4737-9029-5b7499218ffb service nova] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-41df24b4-8092-40c8-91a6-b4aa45f6a7cd req-6f5c4972-f805-4737-9029-5b7499218ffb service nova] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-41df24b4-8092-40c8-91a6-b4aa45f6a7cd req-6f5c4972-f805-4737-9029-5b7499218ffb service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] No waiting events found dispatching network-vif-plugged-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:10 user nova-compute[70659]: WARNING nova.compute.manager [req-41df24b4-8092-40c8-91a6-b4aa45f6a7cd req-6f5c4972-f805-4737-9029-5b7499218ffb service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received unexpected event network-vif-plugged-6f4f826d-bafb-41e5-9929-23a779295abc for instance with vm_state building and task_state spawning.
Jul 25 17:17:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:17:12 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:17:12 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8455MB free_disk=24.944843292236328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305432.5319514, 96626839-75ba-4041-bd5e-4aba16288077 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:17:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 96626839-75ba-4041-bd5e-4aba16288077] VM Resumed (Lifecycle Event)
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:17:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Instance spawned successfully.
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:17:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 96626839-75ba-4041-bd5e-4aba16288077] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305432.5335703, 96626839-75ba-4041-bd5e-4aba16288077 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:17:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 96626839-75ba-4041-bd5e-4aba16288077] VM Started (Lifecycle Event)
Jul 25 17:17:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:17:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 96626839-75ba-4041-bd5e-4aba16288077] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:17:12 user nova-compute[70659]: INFO nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Took 4.96 seconds to spawn the instance on the hypervisor.
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-7bd0e849-b9cc-482f-9c4b-a9d14e63879c req-cfdc4b54-cd71-4e73-ba4a-c2a5d63b3bb0 service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received event network-vif-plugged-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7bd0e849-b9cc-482f-9c4b-a9d14e63879c req-cfdc4b54-cd71-4e73-ba4a-c2a5d63b3bb0 service nova] Acquiring lock "96626839-75ba-4041-bd5e-4aba16288077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7bd0e849-b9cc-482f-9c4b-a9d14e63879c req-cfdc4b54-cd71-4e73-ba4a-c2a5d63b3bb0 service nova] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-7bd0e849-b9cc-482f-9c4b-a9d14e63879c req-cfdc4b54-cd71-4e73-ba4a-c2a5d63b3bb0 service nova] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-7bd0e849-b9cc-482f-9c4b-a9d14e63879c req-cfdc4b54-cd71-4e73-ba4a-c2a5d63b3bb0 service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] No waiting events found dispatching network-vif-plugged-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:12 user nova-compute[70659]: WARNING nova.compute.manager [req-7bd0e849-b9cc-482f-9c4b-a9d14e63879c req-cfdc4b54-cd71-4e73-ba4a-c2a5d63b3bb0 service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received unexpected event network-vif-plugged-6f4f826d-bafb-41e5-9929-23a779295abc for instance with vm_state building and task_state spawning.
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d37c53e1-18e7-4812-a214-dbffc71e0216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 96626839-75ba-4041-bd5e-4aba16288077 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:17:12 user nova-compute[70659]: INFO nova.compute.manager [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Took 17.67 seconds to build instance.
Jul 25 17:17:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-aad6fd75-deba-41d2-84ff-b35f985fadfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "96626839-75ba-4041-bd5e-4aba16288077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.759s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:17:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:17:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:18 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:17:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:17:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:17:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:17:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updating instance_info_cache with network_info: [{"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:17:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:17:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:17:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:17:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:17:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:17:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:17:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:17:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 17:17:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:33 user nova-compute[70659]: INFO nova.compute.manager [None req-dfe9ae5f-0d50-4b57-a531-2a4717d21612 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Unrescuing
Jul 25 17:17:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfe9ae5f-0d50-4b57-a531-2a4717d21612 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:17:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfe9ae5f-0d50-4b57-a531-2a4717d21612 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:17:33 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dfe9ae5f-0d50-4b57-a531-2a4717d21612 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-dfe9ae5f-0d50-4b57-a531-2a4717d21612 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-dfe9ae5f-0d50-4b57-a531-2a4717d21612 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG nova.objects.instance [None req-dfe9ae5f-0d50-4b57-a531-2a4717d21612 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'flavor' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-6cd02f7a-aa05-4a86-a814-facd2fd8eb13 req-5b403cdb-141c-4ef3-a566-d626c2707c23 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6cd02f7a-aa05-4a86-a814-facd2fd8eb13 req-5b403cdb-141c-4ef3-a566-d626c2707c23 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6cd02f7a-aa05-4a86-a814-facd2fd8eb13 req-5b403cdb-141c-4ef3-a566-d626c2707c23 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-6cd02f7a-aa05-4a86-a814-facd2fd8eb13 req-5b403cdb-141c-4ef3-a566-d626c2707c23 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-6cd02f7a-aa05-4a86-a814-facd2fd8eb13 req-5b403cdb-141c-4ef3-a566-d626c2707c23 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:34 user nova-compute[70659]: WARNING nova.compute.manager [req-6cd02f7a-aa05-4a86-a814-facd2fd8eb13 req-5b403cdb-141c-4ef3-a566-d626c2707c23 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:17:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Instance destroyed successfully.
Jul 25 17:17:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:36 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-changed-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Refreshing instance network info cache due to event network-changed-a53e8969-1594-4568-aeb6-80263ee2cf1a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Refreshing network info cache for port a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updated VIF entry in instance network info cache for port a53e8969-1594-4568-aeb6-80263ee2cf1a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-changed-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Refreshing instance network info cache due to event network-changed-a53e8969-1594-4568-aeb6-80263ee2cf1a. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:17:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Refreshing network info cache for port a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updated VIF entry in instance network info cache for port a53e8969-1594-4568-aeb6-80263ee2cf1a. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:38 user nova-compute[70659]: WARNING nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:38 user nova-compute[70659]: WARNING nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:38 user nova-compute[70659]: WARNING nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:38 user nova-compute[70659]: WARNING nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:38 user nova-compute[70659]: WARNING nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:38 user nova-compute[70659]: WARNING nova.compute.manager [req-c055074a-daec-485e-9640-9dedbd9b69dc req-3e4218ac-230c-4d2f-9820-10905b7405c6 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state rescued and task_state unrescuing.
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Removed pending event for d37c53e1-18e7-4812-a214-dbffc71e0216 due to event {{(pid=70659) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305458.8974972, d37c53e1-18e7-4812-a214-dbffc71e0216 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:17:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] VM Resumed (Lifecycle Event)
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-dfe9ae5f-0d50-4b57-a531-2a4717d21612 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:17:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305458.8994637, d37c53e1-18e7-4812-a214-dbffc71e0216 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:17:38 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] VM Started (Lifecycle Event)
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:17:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:17:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-2efe0ee3-2f94-47e5-a8e0-187622c7c6a3 req-44582ebf-d433-457c-8c80-c275ae045174 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:17:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2efe0ee3-2f94-47e5-a8e0-187622c7c6a3 req-44582ebf-d433-457c-8c80-c275ae045174 service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:17:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2efe0ee3-2f94-47e5-a8e0-187622c7c6a3 req-44582ebf-d433-457c-8c80-c275ae045174 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:17:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2efe0ee3-2f94-47e5-a8e0-187622c7c6a3 req-44582ebf-d433-457c-8c80-c275ae045174 service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:17:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-2efe0ee3-2f94-47e5-a8e0-187622c7c6a3 req-44582ebf-d433-457c-8c80-c275ae045174 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:17:39 user nova-compute[70659]: WARNING nova.compute.manager [req-2efe0ee3-2f94-47e5-a8e0-187622c7c6a3 req-44582ebf-d433-457c-8c80-c275ae045174 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state active and task_state None.
Jul 25 17:17:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:17:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:17:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:07 user nova-compute[70659]: INFO nova.compute.manager [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Detaching volume cfd1d9b2-260c-4232-a674-3741b88a14b6
Jul 25 17:18:07 user nova-compute[70659]: INFO nova.virt.block_device [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Attempting to driver detach volume cfd1d9b2-260c-4232-a674-3741b88a14b6 from mountpoint /dev/vdb
Jul 25 17:18:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Attempting to detach device vdb from instance d37c53e1-18e7-4812-a214-dbffc71e0216 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:18:07 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:18:07 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:18:07 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:18:07 user nova-compute[70659]:   <serial>cfd1d9b2-260c-4232-a674-3741b88a14b6</serial>
Jul 25 17:18:07 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:18:07 user nova-compute[70659]: </disk>
Jul 25 17:18:07 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:18:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Successfully detached device vdb from instance d37c53e1-18e7-4812-a214-dbffc71e0216 from the persistent domain config.
Jul 25 17:18:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d37c53e1-18e7-4812-a214-dbffc71e0216 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:18:07 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:18:07 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:18:07 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:18:07 user nova-compute[70659]:   <serial>cfd1d9b2-260c-4232-a674-3741b88a14b6</serial>
Jul 25 17:18:07 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:18:07 user nova-compute[70659]: </disk>
Jul 25 17:18:07 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690305487.6275873, d37c53e1-18e7-4812-a214-dbffc71e0216 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:18:07 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Successfully detached device vdb from instance d37c53e1-18e7-4812-a214-dbffc71e0216 from the live domain config.
Jul 25 17:18:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHYIFQvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:18:07 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[216bb99f-334c-400c-954b-8f3bb5498a0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aebd9d-f21a-4df1-838d-9121774efa16]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:18:07 user nova-compute[70659]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 (non-flash)
Jul 25 17:18:07 user nova-compute[70659]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd303dcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64fd16f-0c52-489d-bf27-6873cfeee48f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aec3e2-6db8-43a2-b16c-81787cc5dc66]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d8f971-352d-4bcc-af0c-be4c3bf91b44]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c1b0a-5a05-4545-bee5-680beab6682b]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbf293d-6305-4393-91b8-379e1854f327]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb2d566-ad08-408b-85be-e81f6ec6b548]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6, portal: 172.16.0.220,3260]
Jul 25 17:18:07 user nova-compute[70659]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6, portal: 172.16.0.220,3260] successful.
Jul 25 17:18:07 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd1d9b2-260c-4232-a674-3741b88a14b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a061b6-84c8-4ec3-be8e-c8ab30724f2d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] <== disconnect_volume: return (264ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:18:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:18:08 user nova-compute[70659]: DEBUG nova.objects.instance [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'flavor' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:18:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-a2e7c725-3508-413f-ab1b-ef17cb6ce398 tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:10 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:18:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:18:11 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=24.94347381591797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance d37c53e1-18e7-4812-a214-dbffc71e0216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 96626839-75ba-4041-bd5e-4aba16288077 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 17:18:11 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 17:18:12 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:18:12 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:18:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:18:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:18:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-378ae626-b49d-40e8-b1b8-3d9f45f7dbab req-f3e54ad1-449d-4bc0-ab83-c847704f7108 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received event network-changed-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG nova.compute.manager [req-378ae626-b49d-40e8-b1b8-3d9f45f7dbab req-f3e54ad1-449d-4bc0-ab83-c847704f7108 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Refreshing instance network info cache due to event network-changed-77690cb3-b58c-49a7-af20-a9b44951bb44. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-378ae626-b49d-40e8-b1b8-3d9f45f7dbab req-f3e54ad1-449d-4bc0-ab83-c847704f7108 service nova] Acquiring lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-378ae626-b49d-40e8-b1b8-3d9f45f7dbab req-f3e54ad1-449d-4bc0-ab83-c847704f7108 service nova] Acquired lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-378ae626-b49d-40e8-b1b8-3d9f45f7dbab req-f3e54ad1-449d-4bc0-ab83-c847704f7108 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Refreshing network info cache for port 77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-378ae626-b49d-40e8-b1b8-3d9f45f7dbab req-f3e54ad1-449d-4bc0-ab83-c847704f7108 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Updated VIF entry in instance network info cache for port 77690cb3-b58c-49a7-af20-a9b44951bb44. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-378ae626-b49d-40e8-b1b8-3d9f45f7dbab req-f3e54ad1-449d-4bc0-ab83-c847704f7108 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Updating instance_info_cache with network_info: [{"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:18:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-378ae626-b49d-40e8-b1b8-3d9f45f7dbab req-f3e54ad1-449d-4bc0-ab83-c847704f7108 service nova] Releasing lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG nova.objects.instance [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'flavor' on Instance uuid b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:16 user nova-compute[70659]: INFO nova.compute.manager [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Attaching volume a056a503-7239-47ec-85cf-1cd5f1df9bc8 to /dev/vdb
Jul 25 17:18:16 user nova-compute[70659]: DEBUG os_brick.utils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5a9394-eb6c-476c-a564-264ec1eb35f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[685aaea0-21fd-415e-87e9-4b1a124efb91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[82223aa1-ce1d-4513-b229-3066b7a19145]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4c1812-5c78-43e7-bc23-a3a4b692f443]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:18:16 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:18:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55b7cb8-6c87-4577-8d81-7c15d0f48372]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG os_brick.utils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:18:16 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Updating existing volume attachment record: cd9906e7-25a8-4a43-a3a5-7d3bccd9e78c {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:18:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [{"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-d37c53e1-18e7-4812-a214-dbffc71e0216" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:18:18 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:18:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:18:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOgIcJEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:18:23 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:18:23 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:18:23 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e88dd6-423a-4a61-af20-e73e2c1766aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:18:23 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dadd4b-e595-4669-8717-46620e95db23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8] added
Jul 25 17:18:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ae5149-e8e0-4266-916a-fcec72f6204a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45ad5ec-1412-4c0d-9ae6-0ace170e129d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lOgIcJEt {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lOgIcJEt" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[77266de7-5f03-4ec6-8d1a-7fd8860b34bd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lOgIcJEt'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c214be9-9043-4f31-890b-75b1f1bae3c0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a61014b-612c-47a0-bf7f-0e15ede25582]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1495c909-3fb9-4014-924d-149d23cfde72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8, portal: 172.16.0.220,3260]
Jul 25 17:18:23 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8, portal: 172.16.0.220,3260] successful.
Jul 25 17:18:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9adb41e-2168-4a36-823a-030ffbd21698]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[54db22ee-d2bc-4038-b93a-eb65432131aa]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:23 user nova-compute[70659]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 (non-flash)
Jul 25 17:18:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:23 user nova-compute[70659]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 (non-flash)
Jul 25 17:18:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[84452857-3464-47e5-9133-f4469745595f]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:18:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:24 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:18:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOgIcJEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:18:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:18:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23336373031343437', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:18:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336373031343437', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:18:24 user nova-compute[70659]: DEBUG nova.objects.instance [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'flavor' on Instance uuid b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:18:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:18:24 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:18:24 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:18:24 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:18:24 user nova-compute[70659]:   <serial>a056a503-7239-47ec-85cf-1cd5f1df9bc8</serial>
Jul 25 17:18:24 user nova-compute[70659]: </disk>
Jul 25 17:18:24 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:18:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:18:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:18:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] No VIF found with MAC fa:16:3e:30:08:42, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:18:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3256444e-5788-4324-a6f9-84260c86e90e tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.453s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:26 user nova-compute[70659]: INFO nova.compute.manager [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Detaching volume a056a503-7239-47ec-85cf-1cd5f1df9bc8
Jul 25 17:18:26 user nova-compute[70659]: INFO nova.virt.block_device [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Attempting to driver detach volume a056a503-7239-47ec-85cf-1cd5f1df9bc8 from mountpoint /dev/vdb
Jul 25 17:18:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Attempting to detach device vdb from instance b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:18:26 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:18:26 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:18:26 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:18:26 user nova-compute[70659]:   <serial>a056a503-7239-47ec-85cf-1cd5f1df9bc8</serial>
Jul 25 17:18:26 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:18:26 user nova-compute[70659]: </disk>
Jul 25 17:18:26 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:18:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Successfully detached device vdb from instance b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f from the persistent domain config.
Jul 25 17:18:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:18:26 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:18:26 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:18:26 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:18:26 user nova-compute[70659]:   <serial>a056a503-7239-47ec-85cf-1cd5f1df9bc8</serial>
Jul 25 17:18:26 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:18:26 user nova-compute[70659]: </disk>
Jul 25 17:18:26 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690305506.956945, b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:18:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Successfully detached device vdb from instance b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f from the live domain config.
Jul 25 17:18:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOgIcJEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:18:26 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:18:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8678f5-c9f8-4422-af69-6a58784252c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[37350f0b-871a-4003-8252-7028e30f29de]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:27 user nova-compute[70659]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 (non-flash)
Jul 25 17:18:27 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:27 user nova-compute[70659]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 (non-flash)
Jul 25 17:18:27 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd28252d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d4157d-2311-4070-aad7-25093d6575f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[28084e3e-b1b2-4b33-bbc6-1722e55f0b75]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1a244-9c06-4317-be9a-2be153591c11]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0f06c7-1dc9-4edc-890f-8a35b03bdf3e]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f077533f-c9ce-4ddf-b643-6b9f832c334f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c629f8f-9b0a-4ca9-816a-45828b73c204]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8, portal: 172.16.0.220,3260]
Jul 25 17:18:27 user nova-compute[70659]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8, portal: 172.16.0.220,3260] successful.
Jul 25 17:18:27 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a056a503-7239-47ec-85cf-1cd5f1df9bc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[05742425-eca0-4cd8-a8f6-ff1a78dd5d94]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] <== disconnect_volume: return (270ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:18:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:28 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'flavor' on Instance uuid b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:18:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b4697964-42ad-45b2-bbab-080d003374fe tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:18:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:18:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:18:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:18:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:18:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:18:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:18:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:18:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:18:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "96626839-75ba-4041-bd5e-4aba16288077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "96626839-75ba-4041-bd5e-4aba16288077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "96626839-75ba-4041-bd5e-4aba16288077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:45 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:45 user nova-compute[70659]: INFO nova.compute.manager [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Terminating instance
Jul 25 17:18:45 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:18:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac1c088b-3b10-4eae-beb8-99f640ada0b6 req-fbadaa7c-d71b-4fa6-8b98-90c7886a998f service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received event network-vif-unplugged-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac1c088b-3b10-4eae-beb8-99f640ada0b6 req-fbadaa7c-d71b-4fa6-8b98-90c7886a998f service nova] Acquiring lock "96626839-75ba-4041-bd5e-4aba16288077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac1c088b-3b10-4eae-beb8-99f640ada0b6 req-fbadaa7c-d71b-4fa6-8b98-90c7886a998f service nova] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ac1c088b-3b10-4eae-beb8-99f640ada0b6 req-fbadaa7c-d71b-4fa6-8b98-90c7886a998f service nova] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac1c088b-3b10-4eae-beb8-99f640ada0b6 req-fbadaa7c-d71b-4fa6-8b98-90c7886a998f service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] No waiting events found dispatching network-vif-unplugged-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-ac1c088b-3b10-4eae-beb8-99f640ada0b6 req-fbadaa7c-d71b-4fa6-8b98-90c7886a998f service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received event network-vif-unplugged-6f4f826d-bafb-41e5-9929-23a779295abc for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:18:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Instance destroyed successfully.
Jul 25 17:18:46 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'resources' on Instance uuid 96626839-75ba-4041-bd5e-4aba16288077 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-204340854',display_name='tempest-TestVolumeBootPattern-server-204340854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-204340854',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:17:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-54ehvp7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:17:13Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=96626839-75ba-4041-bd5e-4aba16288077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "6f4f826d-bafb-41e5-9929-23a779295abc", "address": "fa:16:3e:60:65:34", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4f826d-ba", "ovs_interfaceid": "6f4f826d-bafb-41e5-9929-23a779295abc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:65:34,bridge_name='br-int',has_traffic_filtering=True,id=6f4f826d-bafb-41e5-9929-23a779295abc,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4f826d-ba') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_vif [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:65:34,bridge_name='br-int',has_traffic_filtering=True,id=6f4f826d-bafb-41e5-9929-23a779295abc,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4f826d-ba') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f4f826d-ba, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:18:46 user nova-compute[70659]: INFO os_vif [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:65:34,bridge_name='br-int',has_traffic_filtering=True,id=6f4f826d-bafb-41e5-9929-23a779295abc,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4f826d-ba')
Jul 25 17:18:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUzfdjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:18:46 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b2b5d-269c-41c3-968d-2f98cc0ef889]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad3e1f-65ef-41cd-8f79-91a0208aa1c6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 (non-flash)
Jul 25 17:18:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd282836d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478'): ({'sdc'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Removing single pathed devices sdc {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a0d30d-ec85-44a2-aa4c-67aa399fc2a1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0349c09f-c84e-4bc4-94a1-94d9db5bcb1b]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flushing IO for device /dev/sdc {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5d07fc-36be-4d8b-8924-a0927ec13bda]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[33551848-2f84-45ca-87f6-cc6c618e92d2]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26464623533653161', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ce58a3df', '/dev/disk/by-id/scsi-1SCST_BIOce58a3df-ddb53e1afbbde2b1') {{(pid=81811) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b209603-267a-496d-8caa-69e8263c2893]: (4, None) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaa2695-631c-4b7b-95b7-7401d0a94d70]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ec052-8ed6-4db9-81bc-6c23f02339a1]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478, portal: 172.16.0.220,3260]
Jul 25 17:18:46 user nova-compute[70659]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478, portal: 172.16.0.220,3260] successful.
Jul 25 17:18:46 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a36311-9d54-4c00-8b69-1ba49ebce478 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0353432d-3765-4251-889b-d8e8a1613894]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== disconnect_volume: return (277ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:18:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:18:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Deleting instance files /opt/stack/data/nova/instances/96626839-75ba-4041-bd5e-4aba16288077_del
Jul 25 17:18:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Deletion of /opt/stack/data/nova/instances/96626839-75ba-4041-bd5e-4aba16288077_del complete
Jul 25 17:18:47 user nova-compute[70659]: INFO nova.compute.manager [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 25 17:18:47 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:18:47 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:18:47 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 96626839-75ba-4041-bd5e-4aba16288077] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:18:47 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:18:47 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Took 0.51 seconds to deallocate network for instance.
Jul 25 17:18:47 user nova-compute[70659]: DEBUG nova.compute.manager [req-c41573dc-d10e-4d4a-be4f-c74ceb807bb5 req-4b4f5944-80f1-43e4-a18f-987ad2c2a665 service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received event network-vif-deleted-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:18:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:48 user nova-compute[70659]: INFO nova.compute.manager [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Took 0.70 seconds to detach 1 volumes for instance.
Jul 25 17:18:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Deleting volume: a5a36311-9d54-4c00-8b69-1ba49ebce478 {{(pid=70659) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 17:18:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-0fc49bba-9abe-41bf-a44a-0f5d4be4182e req-1b120812-844e-435b-910c-9de11db26118 service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received event network-vif-plugged-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:18:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0fc49bba-9abe-41bf-a44a-0f5d4be4182e req-1b120812-844e-435b-910c-9de11db26118 service nova] Acquiring lock "96626839-75ba-4041-bd5e-4aba16288077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0fc49bba-9abe-41bf-a44a-0f5d4be4182e req-1b120812-844e-435b-910c-9de11db26118 service nova] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0fc49bba-9abe-41bf-a44a-0f5d4be4182e req-1b120812-844e-435b-910c-9de11db26118 service nova] Lock "96626839-75ba-4041-bd5e-4aba16288077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:48 user nova-compute[70659]: DEBUG nova.compute.manager [req-0fc49bba-9abe-41bf-a44a-0f5d4be4182e req-1b120812-844e-435b-910c-9de11db26118 service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] No waiting events found dispatching network-vif-plugged-6f4f826d-bafb-41e5-9929-23a779295abc {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:18:48 user nova-compute[70659]: WARNING nova.compute.manager [req-0fc49bba-9abe-41bf-a44a-0f5d4be4182e req-1b120812-844e-435b-910c-9de11db26118 service nova] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Received unexpected event network-vif-plugged-6f4f826d-bafb-41e5-9929-23a779295abc for instance with vm_state active and task_state deleting.
Jul 25 17:18:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:18:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:18:48 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:18:48 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:18:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:48 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Deleted allocations for instance 96626839-75ba-4041-bd5e-4aba16288077
Jul 25 17:18:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d53b2bd5-f6fe-4b9b-92ce-eedd07f33b7d tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "96626839-75ba-4041-bd5e-4aba16288077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.769s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:18:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:18:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:01 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305526.6627235, 96626839-75ba-4041-bd5e-4aba16288077 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:19:01 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 96626839-75ba-4041-bd5e-4aba16288077] VM Stopped (Lifecycle Event)
Jul 25 17:19:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bcff08be-b606-48b4-b442-317ea82dd3ca None None] [instance: 96626839-75ba-4041-bd5e-4aba16288077] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:19:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:01 user nova-compute[70659]: INFO nova.compute.manager [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Terminating instance
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-da848898-e140-429a-8be7-89b0d264cd80 req-82570233-2ea5-4ac6-aa17-560c692a948c service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-da848898-e140-429a-8be7-89b0d264cd80 req-82570233-2ea5-4ac6-aa17-560c692a948c service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-da848898-e140-429a-8be7-89b0d264cd80 req-82570233-2ea5-4ac6-aa17-560c692a948c service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-da848898-e140-429a-8be7-89b0d264cd80 req-82570233-2ea5-4ac6-aa17-560c692a948c service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-da848898-e140-429a-8be7-89b0d264cd80 req-82570233-2ea5-4ac6-aa17-560c692a948c service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-da848898-e140-429a-8be7-89b0d264cd80 req-82570233-2ea5-4ac6-aa17-560c692a948c service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-unplugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:19:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Instance destroyed successfully.
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.objects.instance [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lazy-loading 'resources' on Instance uuid d37c53e1-18e7-4812-a214-dbffc71e0216 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-852746328',display_name='tempest-ServerStableDeviceRescueTest-server-852746328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-852746328',id=43,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz3xeqmkXz6C99ZCKhGq25Z5AkBW7ooXchDbKcT5VURn4ody3Vw+lkdLY+/R8IkYRaGlvf2GwFtzi+RnAKdGPBs1OzDVs0QC+JxyJntBwz/nWGExkzaogs55pltBTHKTg==',key_name='tempest-keypair-1452050967',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d7318af6ccc485a9a016177fad1b51d',ramdisk_id='',reservation_id='r-evgda7wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-611517675',owner_user_name='tempest-ServerStableDeviceRescueTest-611517675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1519b2850b2413a983a498d0cecbf91',uuid=d37c53e1-18e7-4812-a214-dbffc71e0216,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Converting VIF {"id": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "address": "fa:16:3e:46:76:94", "network": {"id": "3200629f-794a-4fdc-a915-18ebcf190430", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1767173499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d7318af6ccc485a9a016177fad1b51d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53e8969-15", "ovs_interfaceid": "a53e8969-1594-4568-aeb6-80263ee2cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:76:94,bridge_name='br-int',has_traffic_filtering=True,id=a53e8969-1594-4568-aeb6-80263ee2cf1a,network=Network(3200629f-794a-4fdc-a915-18ebcf190430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53e8969-15') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG os_vif [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:76:94,bridge_name='br-int',has_traffic_filtering=True,id=a53e8969-1594-4568-aeb6-80263ee2cf1a,network=Network(3200629f-794a-4fdc-a915-18ebcf190430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53e8969-15') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa53e8969-15, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:02 user nova-compute[70659]: INFO os_vif [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:76:94,bridge_name='br-int',has_traffic_filtering=True,id=a53e8969-1594-4568-aeb6-80263ee2cf1a,network=Network(3200629f-794a-4fdc-a915-18ebcf190430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53e8969-15')
Jul 25 17:19:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Deleting instance files /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216_del
Jul 25 17:19:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Deletion of /opt/stack/data/nova/instances/d37c53e1-18e7-4812-a214-dbffc71e0216_del complete
Jul 25 17:19:02 user nova-compute[70659]: INFO nova.compute.manager [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 25 17:19:02 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:19:02 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:19:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:19:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-ab7472be-fdf4-4194-8280-b048d4a357a2 req-4041a1db-e625-4f79-b7ff-27c87bc3e17f service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:19:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ab7472be-fdf4-4194-8280-b048d4a357a2 req-4041a1db-e625-4f79-b7ff-27c87bc3e17f service nova] Acquiring lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ab7472be-fdf4-4194-8280-b048d4a357a2 req-4041a1db-e625-4f79-b7ff-27c87bc3e17f service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ab7472be-fdf4-4194-8280-b048d4a357a2 req-4041a1db-e625-4f79-b7ff-27c87bc3e17f service nova] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:04 user nova-compute[70659]: DEBUG nova.compute.manager [req-ab7472be-fdf4-4194-8280-b048d4a357a2 req-4041a1db-e625-4f79-b7ff-27c87bc3e17f service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] No waiting events found dispatching network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:19:04 user nova-compute[70659]: WARNING nova.compute.manager [req-ab7472be-fdf4-4194-8280-b048d4a357a2 req-4041a1db-e625-4f79-b7ff-27c87bc3e17f service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received unexpected event network-vif-plugged-a53e8969-1594-4568-aeb6-80263ee2cf1a for instance with vm_state active and task_state deleting.
Jul 25 17:19:04 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:19:04 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Took 1.69 seconds to deallocate network for instance.
Jul 25 17:19:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:04 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:19:04 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:19:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:04 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Deleted allocations for instance d37c53e1-18e7-4812-a214-dbffc71e0216
Jul 25 17:19:04 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f6fa6d37-449b-4b0b-b605-dd6d2ee3d1bf tempest-ServerStableDeviceRescueTest-611517675 tempest-ServerStableDeviceRescueTest-611517675-project-member] Lock "d37c53e1-18e7-4812-a214-dbffc71e0216" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.889s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:06 user nova-compute[70659]: DEBUG nova.compute.manager [req-44c312a5-db1e-4af7-a67b-882dba43368f req-9c4ff595-9a0a-4ccf-8691-840e3e105f57 service nova] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Received event network-vif-deleted-a53e8969-1594-4568-aeb6-80263ee2cf1a {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:19:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:12 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:13 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:19:13 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:19:13 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=25.067222595214844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:19:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:19:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:19:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:19:16 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc46cecb-f21e-4a8e-b6df-dcc32fe31cf7 req-d3b9a6e9-d6fe-4920-a773-f23224d099ca service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received event network-changed-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc46cecb-f21e-4a8e-b6df-dcc32fe31cf7 req-d3b9a6e9-d6fe-4920-a773-f23224d099ca service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Refreshing instance network info cache due to event network-changed-77690cb3-b58c-49a7-af20-a9b44951bb44. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc46cecb-f21e-4a8e-b6df-dcc32fe31cf7 req-d3b9a6e9-d6fe-4920-a773-f23224d099ca service nova] Acquiring lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc46cecb-f21e-4a8e-b6df-dcc32fe31cf7 req-d3b9a6e9-d6fe-4920-a773-f23224d099ca service nova] Acquired lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc46cecb-f21e-4a8e-b6df-dcc32fe31cf7 req-d3b9a6e9-d6fe-4920-a773-f23224d099ca service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Refreshing network info cache for port 77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:17 user nova-compute[70659]: INFO nova.compute.manager [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Terminating instance
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-5236ed1d-b038-4bb0-b3bd-25ed94aec23a req-07ed42d4-8470-473d-be44-3a95d5aa78f8 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received event network-vif-unplugged-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5236ed1d-b038-4bb0-b3bd-25ed94aec23a req-07ed42d4-8470-473d-be44-3a95d5aa78f8 service nova] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5236ed1d-b038-4bb0-b3bd-25ed94aec23a req-07ed42d4-8470-473d-be44-3a95d5aa78f8 service nova] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-5236ed1d-b038-4bb0-b3bd-25ed94aec23a req-07ed42d4-8470-473d-be44-3a95d5aa78f8 service nova] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-5236ed1d-b038-4bb0-b3bd-25ed94aec23a req-07ed42d4-8470-473d-be44-3a95d5aa78f8 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] No waiting events found dispatching network-vif-unplugged-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-5236ed1d-b038-4bb0-b3bd-25ed94aec23a req-07ed42d4-8470-473d-be44-3a95d5aa78f8 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received event network-vif-unplugged-77690cb3-b58c-49a7-af20-a9b44951bb44 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305542.7488754, d37c53e1-18e7-4812-a214-dbffc71e0216 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:19:17 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] VM Stopped (Lifecycle Event)
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b1640756-c5d6-4f51-9d96-762a21995278 None None] [instance: d37c53e1-18e7-4812-a214-dbffc71e0216] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc46cecb-f21e-4a8e-b6df-dcc32fe31cf7 req-d3b9a6e9-d6fe-4920-a773-f23224d099ca service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Updated VIF entry in instance network info cache for port 77690cb3-b58c-49a7-af20-a9b44951bb44. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc46cecb-f21e-4a8e-b6df-dcc32fe31cf7 req-d3b9a6e9-d6fe-4920-a773-f23224d099ca service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Updating instance_info_cache with network_info: [{"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc46cecb-f21e-4a8e-b6df-dcc32fe31cf7 req-d3b9a6e9-d6fe-4920-a773-f23224d099ca service nova] Releasing lock "refresh_cache-b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:19:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Instance destroyed successfully.
Jul 25 17:19:18 user nova-compute[70659]: DEBUG nova.objects.instance [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'resources' on Instance uuid b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2093266478',display_name='tempest-TestStampPattern-server-2093266478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2093266478',id=45,image_ref='5f528e3a-9dcf-4461-aa51-d8b0ed5f475a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOOlRrRN0KR8cIS6x0jll4OvcwrbmMAOMg1oZoyhryjalnx73JWUBSS4sKhMJusonzt8duDEurlo6TgbynL0NG1ofMvVQwRJZ0c0JffXN2APhhi/W19pK3O3reUHdkO2A==',key_name='tempest-TestStampPattern-1951316000',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:16:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fd36eec8cf4442a85d605df4f9346b4',ramdisk_id='',reservation_id='r-o1oymduy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0342c9d7-fe5c-4fd8-919b-3a07dc505713',image_min_disk='1',image_min_ram='0',image_owner_id='8fd36eec8cf4442a85d605df4f9346b4',image_owner_project_name='tempest-TestStampPattern-1207444888',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1207444888-project-member',image_user_id='71c2ae08dbdc4cb39c8b19b04cf0f73a',owner_project_name='tempest-TestStampPattern-1207444888',owner_user_name='tempest-TestStampPattern-1207444888-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:16:31Z,user_data=None,user_id='71c2ae08dbdc4cb39c8b19b04cf0f73a',uuid=b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converting VIF {"id": "77690cb3-b58c-49a7-af20-a9b44951bb44", "address": "fa:16:3e:30:08:42", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77690cb3-b5", "ovs_interfaceid": "77690cb3-b58c-49a7-af20-a9b44951bb44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:08:42,bridge_name='br-int',has_traffic_filtering=True,id=77690cb3-b58c-49a7-af20-a9b44951bb44,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77690cb3-b5') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG os_vif [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:08:42,bridge_name='br-int',has_traffic_filtering=True,id=77690cb3-b58c-49a7-af20-a9b44951bb44,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77690cb3-b5') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77690cb3-b5, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:18 user nova-compute[70659]: INFO os_vif [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:08:42,bridge_name='br-int',has_traffic_filtering=True,id=77690cb3-b58c-49a7-af20-a9b44951bb44,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77690cb3-b5')
Jul 25 17:19:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Deleting instance files /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f_del
Jul 25 17:19:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Deletion of /opt/stack/data/nova/instances/b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f_del complete
Jul 25 17:19:18 user nova-compute[70659]: INFO nova.compute.manager [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 25 17:19:18 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:19:18 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Took 0.52 seconds to deallocate network for instance.
Jul 25 17:19:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:19:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:18 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Deleted allocations for instance b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f
Jul 25 17:19:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-bee1777f-3491-498f-85d1-d7516f62acce tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.646s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-0d4a7516-fb94-4ec3-8c76-e0998aab3784 req-1fd0c7c5-9061-4401-8106-efb2324e6d70 service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received event network-vif-deleted-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:19:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-948e9862-7819-44d4-9e60-3992a6d53fef req-a5c12a7c-8ef4-41e1-aeca-212298df96df service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received event network-vif-plugged-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:19:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-948e9862-7819-44d4-9e60-3992a6d53fef req-a5c12a7c-8ef4-41e1-aeca-212298df96df service nova] Acquiring lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-948e9862-7819-44d4-9e60-3992a6d53fef req-a5c12a7c-8ef4-41e1-aeca-212298df96df service nova] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-948e9862-7819-44d4-9e60-3992a6d53fef req-a5c12a7c-8ef4-41e1-aeca-212298df96df service nova] Lock "b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-948e9862-7819-44d4-9e60-3992a6d53fef req-a5c12a7c-8ef4-41e1-aeca-212298df96df service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] No waiting events found dispatching network-vif-plugged-77690cb3-b58c-49a7-af20-a9b44951bb44 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:19:19 user nova-compute[70659]: WARNING nova.compute.manager [req-948e9862-7819-44d4-9e60-3992a6d53fef req-a5c12a7c-8ef4-41e1-aeca-212298df96df service nova] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Received unexpected event network-vif-plugged-77690cb3-b58c-49a7-af20-a9b44951bb44 for instance with vm_state deleted and task_state None.
Jul 25 17:19:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:19:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:19:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:19:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:19:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:19:20 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updating instance_info_cache with network_info: [{"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:19:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:19:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:19:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:19:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:33 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305558.1503716, b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:19:33 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] VM Stopped (Lifecycle Event)
Jul 25 17:19:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-110baaa2-189b-4038-8ede-a0cecdd466b2 None None] [instance: b1b22ade-1ac0-4ce0-ba3e-9cf65d500c4f] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:19:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:19:50 user nova-compute[70659]: INFO nova.compute.claims [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Claim successful on node user
Jul 25 17:19:50 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:19:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:19:50 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:19:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:19:50 user nova-compute[70659]: INFO nova.virt.block_device [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Booting with volume 0ff6e299-a244-41f9-8d71-f3da986e4a88 at /dev/vda
Jul 25 17:19:50 user nova-compute[70659]: DEBUG nova.policy [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80d4bea31bd94de88d07d0b7bae77086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ec6ce16624cd8af59a77456e647b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG os_brick.utils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[158a8676-d97a-4a4b-8521-f0e5ba0100b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d33f771-9119-4f7b-90d2-42600162742d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e780fcb-47f0-41e4-9a80-11d101d081a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[537c496c-d7fb-4915-8a0a-53c0ab315e89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:19:51 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:19:51 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[651291d0-63b0-4bb1-843a-93b53a7c70a7]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG os_brick.utils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updating existing volume attachment record: 39a11673-8d9e-43ba-ad64-8cf3d0430d76 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:19:51 user nova-compute[70659]: DEBUG nova.network.neutron [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Successfully created port: f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:19:52 user nova-compute[70659]: DEBUG nova.network.neutron [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Successfully updated port: f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:19:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:19:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquired lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:19:52 user nova-compute[70659]: DEBUG nova.network.neutron [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:19:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-3bbb01b8-0b01-4f8d-8ce6-9b43678ef917 req-38594484-4a16-4243-9f45-082be98afbbf service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-changed-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:19:52 user nova-compute[70659]: DEBUG nova.compute.manager [req-3bbb01b8-0b01-4f8d-8ce6-9b43678ef917 req-38594484-4a16-4243-9f45-082be98afbbf service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Refreshing instance network info cache due to event network-changed-f35d6f99-3d43-4258-9486-8a31893fa0d0. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:19:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3bbb01b8-0b01-4f8d-8ce6-9b43678ef917 req-38594484-4a16-4243-9f45-082be98afbbf service nova] Acquiring lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:19:52 user nova-compute[70659]: DEBUG nova.network.neutron [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:19:53 user nova-compute[70659]: DEBUG nova.network.neutron [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updating instance_info_cache with network_info: [{"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:19:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Releasing lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:19:53 user nova-compute[70659]: DEBUG nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Instance network_info: |[{"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:19:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3bbb01b8-0b01-4f8d-8ce6-9b43678ef917 req-38594484-4a16-4243-9f45-082be98afbbf service nova] Acquired lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:19:53 user nova-compute[70659]: DEBUG nova.network.neutron [req-3bbb01b8-0b01-4f8d-8ce6-9b43678ef917 req-38594484-4a16-4243-9f45-082be98afbbf service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Refreshing network info cache for port f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:19:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:53 user nova-compute[70659]: DEBUG nova.network.neutron [req-3bbb01b8-0b01-4f8d-8ce6-9b43678ef917 req-38594484-4a16-4243-9f45-082be98afbbf service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updated VIF entry in instance network info cache for port f35d6f99-3d43-4258-9486-8a31893fa0d0. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:19:53 user nova-compute[70659]: DEBUG nova.network.neutron [req-3bbb01b8-0b01-4f8d-8ce6-9b43678ef917 req-38594484-4a16-4243-9f45-082be98afbbf service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updating instance_info_cache with network_info: [{"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:19:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3bbb01b8-0b01-4f8d-8ce6-9b43678ef917 req-38594484-4a16-4243-9f45-082be98afbbf service nova] Releasing lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:19:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:19:57 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Creating image(s)
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Ensure instance console log exists: /opt/stack/data/nova/instances/83ac4412-e463-4f01-99c9-53a437fb1c0c/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Start _get_guest_xml network_info=[{"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '39a11673-8d9e-43ba-ad64-8cf3d0430d76', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgmqtKwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83ac4412-e463-4f01-99c9-53a437fb1c0c', 'attached_at': '', 'detached_at': '', 'volume_id': '0ff6e299-a244-41f9-8d71-f3da986e4a88', 'serial': '0ff6e299-a244-41f9-8d71-f3da986e4a88'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:19:57 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:19:57 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgmqtKwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:19:57 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:19:57 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:19:57 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[db851315-60ca-4a0d-ac0f-923660df15b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:19:57 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a95d08-af17-4315-ab2c-dd4639fe0540]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88] added
Jul 25 17:19:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[10592025-3669-409a-bfcb-f4fbf92dbbb1]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65e6e5b-debf-46d3-ab90-08b73b2b234f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgmqtKwL {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgmqtKwL" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b764675f-9abf-482c-b6ce-e6c1fdf0d83d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OgmqtKwL'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fefb926-cc56-45dd-ab4c-3a2e486c9bb8]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0468d741-a5f0-4512-85cf-08ca0432f19c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:19:57 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:19:57 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:19:57 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 17:19:57 user nova-compute[70659]: 
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ea91b-16e6-4d16-ada6-f36b7b42e763]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88, portal: 172.16.0.220,3260]
Jul 25 17:19:57 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88, portal: 172.16.0.220,3260] successful.
Jul 25 17:19:57 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2b2e3d-876e-42f1-9f18-6d0013a9a5b6]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:19:57 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e53bd-6f93-4b39-b6ac-65245f4ab682]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:19:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:19:58 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5491990d-4552-4e8a-a65e-caca2f36889f]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:19:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgmqtKwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23336363161613436', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336363161613436', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-503899803',display_name='tempest-TestVolumeBootPattern-volume-backed-server-503899803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-503899803',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH87EPsAgHS6TnX88VoCvj1V7mblLYnKJ+bfWJMK8pAGLC3k7uzKrsumgQtddaLz886K1eCTMt3QQD+xHk3afou/Z0kI/6tkZNSfk8RdRrXZ77r05bixn4QvASWbEClP8A==',key_name='tempest-keypair-1668430560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-xhk6lx0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=83ac4412-e463-4f01-99c9-53a437fb1c0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:b9:07,bridge_name='br-int',has_traffic_filtering=True,id=f35d6f99-3d43-4258-9486-8a31893fa0d0,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35d6f99-3d') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.objects.instance [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'pci_devices' on Instance uuid 83ac4412-e463-4f01-99c9-53a437fb1c0c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:19:59 user nova-compute[70659]:   <uuid>83ac4412-e463-4f01-99c9-53a437fb1c0c</uuid>
Jul 25 17:19:59 user nova-compute[70659]:   <name>instance-0000002f</name>
Jul 25 17:19:59 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:19:59 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:19:59 user nova-compute[70659]:   <metadata>
Jul 25 17:19:59 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:19:59 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:19:59 user nova-compute[70659]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-503899803</nova:name>
Jul 25 17:19:59 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:19:57</nova:creationTime>
Jul 25 17:19:59 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:19:59 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:19:59 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:19:59 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:19:59 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:19:59 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:19:59 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:19:59 user nova-compute[70659]:       <nova:owner>
Jul 25 17:19:59 user nova-compute[70659]:         <nova:user uuid="80d4bea31bd94de88d07d0b7bae77086">tempest-TestVolumeBootPattern-1024566986-project-member</nova:user>
Jul 25 17:19:59 user nova-compute[70659]:         <nova:project uuid="f60ec6ce16624cd8af59a77456e647b9">tempest-TestVolumeBootPattern-1024566986</nova:project>
Jul 25 17:19:59 user nova-compute[70659]:       </nova:owner>
Jul 25 17:19:59 user nova-compute[70659]:       <nova:ports>
Jul 25 17:19:59 user nova-compute[70659]:         <nova:port uuid="f35d6f99-3d43-4258-9486-8a31893fa0d0">
Jul 25 17:19:59 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 17:19:59 user nova-compute[70659]:         </nova:port>
Jul 25 17:19:59 user nova-compute[70659]:       </nova:ports>
Jul 25 17:19:59 user nova-compute[70659]:     </nova:instance>
Jul 25 17:19:59 user nova-compute[70659]:   </metadata>
Jul 25 17:19:59 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:19:59 user nova-compute[70659]:     <system>
Jul 25 17:19:59 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:19:59 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:19:59 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:19:59 user nova-compute[70659]:       <entry name="serial">83ac4412-e463-4f01-99c9-53a437fb1c0c</entry>
Jul 25 17:19:59 user nova-compute[70659]:       <entry name="uuid">83ac4412-e463-4f01-99c9-53a437fb1c0c</entry>
Jul 25 17:19:59 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:19:59 user nova-compute[70659]:     </system>
Jul 25 17:19:59 user nova-compute[70659]:   </sysinfo>
Jul 25 17:19:59 user nova-compute[70659]:   <os>
Jul 25 17:19:59 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:19:59 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:19:59 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:19:59 user nova-compute[70659]:   </os>
Jul 25 17:19:59 user nova-compute[70659]:   <features>
Jul 25 17:19:59 user nova-compute[70659]:     <acpi/>
Jul 25 17:19:59 user nova-compute[70659]:     <apic/>
Jul 25 17:19:59 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:19:59 user nova-compute[70659]:   </features>
Jul 25 17:19:59 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:19:59 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:19:59 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:19:59 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:19:59 user nova-compute[70659]:   </clock>
Jul 25 17:19:59 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:19:59 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:19:59 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:19:59 user nova-compute[70659]:   </cpu>
Jul 25 17:19:59 user nova-compute[70659]:   <devices>
Jul 25 17:19:59 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:19:59 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:19:59 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 17:19:59 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:19:59 user nova-compute[70659]:       <serial>0ff6e299-a244-41f9-8d71-f3da986e4a88</serial>
Jul 25 17:19:59 user nova-compute[70659]:     </disk>
Jul 25 17:19:59 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:19:59 user nova-compute[70659]:       <mac address="fa:16:3e:35:b9:07"/>
Jul 25 17:19:59 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:19:59 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:19:59 user nova-compute[70659]:       <target dev="tapf35d6f99-3d"/>
Jul 25 17:19:59 user nova-compute[70659]:     </interface>
Jul 25 17:19:59 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:19:59 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/83ac4412-e463-4f01-99c9-53a437fb1c0c/console.log" append="off"/>
Jul 25 17:19:59 user nova-compute[70659]:     </serial>
Jul 25 17:19:59 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:19:59 user nova-compute[70659]:     <video>
Jul 25 17:19:59 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:19:59 user nova-compute[70659]:     </video>
Jul 25 17:19:59 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:19:59 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:19:59 user nova-compute[70659]:     </rng>
Jul 25 17:19:59 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:19:59 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:19:59 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:19:59 user nova-compute[70659]:     </memballoon>
Jul 25 17:19:59 user nova-compute[70659]:   </devices>
Jul 25 17:19:59 user nova-compute[70659]: </domain>
Jul 25 17:19:59 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-503899803',display_name='tempest-TestVolumeBootPattern-volume-backed-server-503899803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-503899803',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH87EPsAgHS6TnX88VoCvj1V7mblLYnKJ+bfWJMK8pAGLC3k7uzKrsumgQtddaLz886K1eCTMt3QQD+xHk3afou/Z0kI/6tkZNSfk8RdRrXZ77r05bixn4QvASWbEClP8A==',key_name='tempest-keypair-1668430560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-xhk6lx0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=83ac4412-e463-4f01-99c9-53a437fb1c0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:b9:07,bridge_name='br-int',has_traffic_filtering=True,id=f35d6f99-3d43-4258-9486-8a31893fa0d0,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35d6f99-3d') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG os_vif [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:b9:07,bridge_name='br-int',has_traffic_filtering=True,id=f35d6f99-3d43-4258-9486-8a31893fa0d0,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35d6f99-3d') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf35d6f99-3d, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf35d6f99-3d, col_values=(('external_ids', {'iface-id': 'f35d6f99-3d43-4258-9486-8a31893fa0d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:b9:07', 'vm-uuid': '83ac4412-e463-4f01-99c9-53a437fb1c0c'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:19:59 user nova-compute[70659]: INFO os_vif [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:b9:07,bridge_name='br-int',has_traffic_filtering=True,id=f35d6f99-3d43-4258-9486-8a31893fa0d0,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35d6f99-3d')
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:19:59 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No VIF found with MAC fa:16:3e:35:b9:07, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:20:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-92c0eaa8-d53f-466b-b17e-f3ef7b11401d req-1d043884-e320-4512-a0a7-183bf07bb498 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:20:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-92c0eaa8-d53f-466b-b17e-f3ef7b11401d req-1d043884-e320-4512-a0a7-183bf07bb498 service nova] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-92c0eaa8-d53f-466b-b17e-f3ef7b11401d req-1d043884-e320-4512-a0a7-183bf07bb498 service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-92c0eaa8-d53f-466b-b17e-f3ef7b11401d req-1d043884-e320-4512-a0a7-183bf07bb498 service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:00 user nova-compute[70659]: DEBUG nova.compute.manager [req-92c0eaa8-d53f-466b-b17e-f3ef7b11401d req-1d043884-e320-4512-a0a7-183bf07bb498 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] No waiting events found dispatching network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:20:00 user nova-compute[70659]: WARNING nova.compute.manager [req-92c0eaa8-d53f-466b-b17e-f3ef7b11401d req-1d043884-e320-4512-a0a7-183bf07bb498 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received unexpected event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 for instance with vm_state building and task_state spawning.
Jul 25 17:20:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305602.538322, 83ac4412-e463-4f01-99c9-53a437fb1c0c => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:20:02 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] VM Resumed (Lifecycle Event)
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:20:02 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Instance spawned successfully.
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:20:02 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305602.540377, 83ac4412-e463-4f01-99c9-53a437fb1c0c => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:20:02 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] VM Started (Lifecycle Event)
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:20:02 user nova-compute[70659]: INFO nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Took 4.95 seconds to spawn the instance on the hypervisor.
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:02 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-d6849e1c-9449-44e5-a86f-cb88b986fdbf req-2420a571-36ed-4aba-951e-4f93d6697b56 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d6849e1c-9449-44e5-a86f-cb88b986fdbf req-2420a571-36ed-4aba-951e-4f93d6697b56 service nova] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d6849e1c-9449-44e5-a86f-cb88b986fdbf req-2420a571-36ed-4aba-951e-4f93d6697b56 service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-d6849e1c-9449-44e5-a86f-cb88b986fdbf req-2420a571-36ed-4aba-951e-4f93d6697b56 service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:02 user nova-compute[70659]: DEBUG nova.compute.manager [req-d6849e1c-9449-44e5-a86f-cb88b986fdbf req-2420a571-36ed-4aba-951e-4f93d6697b56 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] No waiting events found dispatching network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:20:02 user nova-compute[70659]: WARNING nova.compute.manager [req-d6849e1c-9449-44e5-a86f-cb88b986fdbf req-2420a571-36ed-4aba-951e-4f93d6697b56 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received unexpected event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 for instance with vm_state building and task_state spawning.
Jul 25 17:20:02 user nova-compute[70659]: INFO nova.compute.manager [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Took 12.29 seconds to build instance.
Jul 25 17:20:02 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-90d5430a-5ee3-47ac-ac35-ddbc06542af9 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.379s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:20:13 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:14 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:20:14 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:20:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=25.155086517333984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 83ac4412-e463-4f01-99c9-53a437fb1c0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:20:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:16 user nova-compute[70659]: INFO nova.compute.manager [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Terminating instance
Jul 25 17:20:16 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-3af1dd6c-88bd-4c77-a6da-e8a0b805f435 req-6a87a3b9-7725-442d-b0e0-7f84b254df78 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-changed-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-3af1dd6c-88bd-4c77-a6da-e8a0b805f435 req-6a87a3b9-7725-442d-b0e0-7f84b254df78 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Refreshing instance network info cache due to event network-changed-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3af1dd6c-88bd-4c77-a6da-e8a0b805f435 req-6a87a3b9-7725-442d-b0e0-7f84b254df78 service nova] Acquiring lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3af1dd6c-88bd-4c77-a6da-e8a0b805f435 req-6a87a3b9-7725-442d-b0e0-7f84b254df78 service nova] Acquired lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG nova.network.neutron [req-3af1dd6c-88bd-4c77-a6da-e8a0b805f435 req-6a87a3b9-7725-442d-b0e0-7f84b254df78 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Refreshing network info cache for port 14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-dbe0624b-a8ea-411f-bfa2-5af1064c05eb req-877f6092-6d96-4861-bf4a-d0d8038c869f service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-vif-unplugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dbe0624b-a8ea-411f-bfa2-5af1064c05eb req-877f6092-6d96-4861-bf4a-d0d8038c869f service nova] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dbe0624b-a8ea-411f-bfa2-5af1064c05eb req-877f6092-6d96-4861-bf4a-d0d8038c869f service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dbe0624b-a8ea-411f-bfa2-5af1064c05eb req-877f6092-6d96-4861-bf4a-d0d8038c869f service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-dbe0624b-a8ea-411f-bfa2-5af1064c05eb req-877f6092-6d96-4861-bf4a-d0d8038c869f service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] No waiting events found dispatching network-vif-unplugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:20:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-dbe0624b-a8ea-411f-bfa2-5af1064c05eb req-877f6092-6d96-4861-bf4a-d0d8038c869f service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-vif-unplugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-3af1dd6c-88bd-4c77-a6da-e8a0b805f435 req-6a87a3b9-7725-442d-b0e0-7f84b254df78 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updated VIF entry in instance network info cache for port 14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-3af1dd6c-88bd-4c77-a6da-e8a0b805f435 req-6a87a3b9-7725-442d-b0e0-7f84b254df78 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updating instance_info_cache with network_info: [{"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-3af1dd6c-88bd-4c77-a6da-e8a0b805f435 req-6a87a3b9-7725-442d-b0e0-7f84b254df78 service nova] Releasing lock "refresh_cache-0342c9d7-fe5c-4fd8-919b-3a07dc505713" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:17 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Instance destroyed successfully.
Jul 25 17:20:17 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lazy-loading 'resources' on Instance uuid 0342c9d7-fe5c-4fd8-919b-3a07dc505713 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-684059401',display_name='tempest-TestStampPattern-server-684059401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-684059401',id=44,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOOlRrRN0KR8cIS6x0jll4OvcwrbmMAOMg1oZoyhryjalnx73JWUBSS4sKhMJusonzt8duDEurlo6TgbynL0NG1ofMvVQwRJZ0c0JffXN2APhhi/W19pK3O3reUHdkO2A==',key_name='tempest-TestStampPattern-1951316000',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fd36eec8cf4442a85d605df4f9346b4',ramdisk_id='',reservation_id='r-ioeamwar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1207444888',owner_user_name='tempest-TestStampPattern-1207444888-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:16:21Z,user_data=None,user_id='71c2ae08dbdc4cb39c8b19b04cf0f73a',uuid=0342c9d7-fe5c-4fd8-919b-3a07dc505713,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converting VIF {"id": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "address": "fa:16:3e:d6:55:c2", "network": {"id": "2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d", "bridge": "br-int", "label": "tempest-TestStampPattern-532982726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fd36eec8cf4442a85d605df4f9346b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d8ddf7-e9", "ovs_interfaceid": "14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:55:c2,bridge_name='br-int',has_traffic_filtering=True,id=14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d8ddf7-e9') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG os_vif [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:55:c2,bridge_name='br-int',has_traffic_filtering=True,id=14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d8ddf7-e9') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14d8ddf7-e9, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:20:17 user nova-compute[70659]: INFO os_vif [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:55:c2,bridge_name='br-int',has_traffic_filtering=True,id=14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb,network=Network(2a2b1b11-b497-4d52-ae6f-9aa3662d5a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d8ddf7-e9')
Jul 25 17:20:17 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Deleting instance files /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713_del
Jul 25 17:20:17 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Deletion of /opt/stack/data/nova/instances/0342c9d7-fe5c-4fd8-919b-3a07dc505713_del complete
Jul 25 17:20:17 user nova-compute[70659]: INFO nova.compute.manager [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 25 17:20:17 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:20:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:20:18 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Took 0.69 seconds to deallocate network for instance.
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-ce9b7369-4b9b-496f-8b92-a49f84610db5 req-338024b2-ab9e-40d1-b36a-28c2af6bd849 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-vif-deleted-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:18 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Deleted allocations for instance 0342c9d7-fe5c-4fd8-919b-3a07dc505713
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ca92f179-339a-49d9-927b-4542f2a6c499 tempest-TestStampPattern-1207444888 tempest-TestStampPattern-1207444888-project-member] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] No waiting events found dispatching network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:20:18 user nova-compute[70659]: WARNING nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received unexpected event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb for instance with vm_state deleted and task_state None.
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] No waiting events found dispatching network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:20:18 user nova-compute[70659]: WARNING nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received unexpected event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb for instance with vm_state deleted and task_state None.
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] No waiting events found dispatching network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:20:18 user nova-compute[70659]: WARNING nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received unexpected event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb for instance with vm_state deleted and task_state None.
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Acquiring lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] Lock "0342c9d7-fe5c-4fd8-919b-3a07dc505713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:20:18 user nova-compute[70659]: DEBUG nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] No waiting events found dispatching network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:20:18 user nova-compute[70659]: WARNING nova.compute.manager [req-9f8bc8d8-bbec-4158-8622-ca6778c72b32 req-ab5e9685-6be6-448d-987d-21c04f3656e8 service nova] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Received unexpected event network-vif-plugged-14d8ddf7-e910-40ed-9f1a-b5f825f0f5cb for instance with vm_state deleted and task_state None.
Jul 25 17:20:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:22 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:20:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:20:22 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 17:20:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:32 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305617.4170473, 0342c9d7-fe5c-4fd8-919b-3a07dc505713 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:20:32 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] VM Stopped (Lifecycle Event)
Jul 25 17:20:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-5e01affe-c86b-4300-9064-664b498a62fe None None] [instance: 0342c9d7-fe5c-4fd8-919b-3a07dc505713] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:20:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:20:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:20:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:20:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:20:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:20:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:20:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:20:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:20:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:20:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:20:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:20:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:20:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:20:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:20:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:20:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:21:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:21:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:21:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:21:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:06 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:21:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:21:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:21:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:21:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:21:14 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:21:14 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:21:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8718MB free_disk=25.180465698242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 83ac4412-e463-4f01-99c9-53a437fb1c0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:21:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:15 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:21:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:18 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:22 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:23 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:21:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:21:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:21:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:21:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:21:23 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid 83ac4412-e463-4f01-99c9-53a437fb1c0c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:21:24 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updating instance_info_cache with network_info: [{"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:21:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:21:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:21:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:21:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:21:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:21:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:21:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Verify base images {{(pid=70659) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=70659) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] 83ac4412-e463-4f01-99c9-53a437fb1c0c is a valid instance name {{(pid=70659) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0
Jul 25 17:21:37 user nova-compute[70659]: WARNING nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Removable base files: /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319 /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2 /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019 /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173 /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0 /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/388db3166485eff41ad3152522697a898372fb0d
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/96efd85d888162a0513c1f3b3ef112e6c25bae6f
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9c97a5023d45ea42a1f4f92e4c92f5e8da2d4319
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/301a16c1f468820443b4eb83e5f4036389b6d3e2
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d814b6d0b555ed6ccf81229ea278478560ff1ed
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/09ca8dba802a50cd580e38f52009aa90e0cfb019
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/769ac1b71e050805c9f4925d1b4fd05744857173
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eb92dcea588f28adcd7aac8c9b5e9b1c269fb8b0
Jul 25 17:21:37 user nova-compute[70659]: INFO nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8d9eb27acbdd6e6110ce3b13486731dd5bee9dfb
Jul 25 17:21:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Verification complete {{(pid=70659) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Verify swap images {{(pid=70659) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG nova.virt.libvirt.imagecache [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Verify ephemeral images {{(pid=70659) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 25 17:21:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-2bad8c15-2364-4e38-9bf9-fe1d089a9aca req-ada66c0a-9606-4e3b-b9ca-cb9bc15e30a9 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-changed-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:21:41 user nova-compute[70659]: DEBUG nova.compute.manager [req-2bad8c15-2364-4e38-9bf9-fe1d089a9aca req-ada66c0a-9606-4e3b-b9ca-cb9bc15e30a9 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Refreshing instance network info cache due to event network-changed-f35d6f99-3d43-4258-9486-8a31893fa0d0. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:21:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2bad8c15-2364-4e38-9bf9-fe1d089a9aca req-ada66c0a-9606-4e3b-b9ca-cb9bc15e30a9 service nova] Acquiring lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:21:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2bad8c15-2364-4e38-9bf9-fe1d089a9aca req-ada66c0a-9606-4e3b-b9ca-cb9bc15e30a9 service nova] Acquired lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:21:41 user nova-compute[70659]: DEBUG nova.network.neutron [req-2bad8c15-2364-4e38-9bf9-fe1d089a9aca req-ada66c0a-9606-4e3b-b9ca-cb9bc15e30a9 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Refreshing network info cache for port f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG nova.network.neutron [req-2bad8c15-2364-4e38-9bf9-fe1d089a9aca req-ada66c0a-9606-4e3b-b9ca-cb9bc15e30a9 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updated VIF entry in instance network info cache for port f35d6f99-3d43-4258-9486-8a31893fa0d0. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG nova.network.neutron [req-2bad8c15-2364-4e38-9bf9-fe1d089a9aca req-ada66c0a-9606-4e3b-b9ca-cb9bc15e30a9 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updating instance_info_cache with network_info: [{"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2bad8c15-2364-4e38-9bf9-fe1d089a9aca req-ada66c0a-9606-4e3b-b9ca-cb9bc15e30a9 service nova] Releasing lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:21:48 user nova-compute[70659]: INFO nova.compute.claims [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Claim successful on node user
Jul 25 17:21:48 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:21:48 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:21:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:21:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:21:48 user nova-compute[70659]: INFO nova.virt.block_device [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Booting with volume snapshot 7334c277-6d6e-4c1c-a28c-66fe99b833df at /dev/vda
Jul 25 17:21:48 user nova-compute[70659]: DEBUG nova.policy [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80d4bea31bd94de88d07d0b7bae77086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ec6ce16624cd8af59a77456e647b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:21:49 user nova-compute[70659]: DEBUG nova.network.neutron [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Successfully created port: 05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:21:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Successfully updated port: 05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:21:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:21:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquired lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:21:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:21:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc98a58f-4530-4863-afcd-1efe79d50b28 req-d0aa663b-be74-4e65-a928-6f6cf6195cc8 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received event network-changed-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:21:50 user nova-compute[70659]: DEBUG nova.compute.manager [req-dc98a58f-4530-4863-afcd-1efe79d50b28 req-d0aa663b-be74-4e65-a928-6f6cf6195cc8 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Refreshing instance network info cache due to event network-changed-05032eba-3cc7-452e-89bd-20e9af0e4570. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:21:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc98a58f-4530-4863-afcd-1efe79d50b28 req-d0aa663b-be74-4e65-a928-6f6cf6195cc8 service nova] Acquiring lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:21:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:21:51 user nova-compute[70659]: DEBUG nova.network.neutron [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Updating instance_info_cache with network_info: [{"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:21:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Releasing lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:21:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Instance network_info: |[{"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:21:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc98a58f-4530-4863-afcd-1efe79d50b28 req-d0aa663b-be74-4e65-a928-6f6cf6195cc8 service nova] Acquired lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:21:51 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc98a58f-4530-4863-afcd-1efe79d50b28 req-d0aa663b-be74-4e65-a928-6f6cf6195cc8 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Refreshing network info cache for port 05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:21:52 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc98a58f-4530-4863-afcd-1efe79d50b28 req-d0aa663b-be74-4e65-a928-6f6cf6195cc8 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Updated VIF entry in instance network info cache for port 05032eba-3cc7-452e-89bd-20e9af0e4570. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:21:52 user nova-compute[70659]: DEBUG nova.network.neutron [req-dc98a58f-4530-4863-afcd-1efe79d50b28 req-d0aa663b-be74-4e65-a928-6f6cf6195cc8 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Updating instance_info_cache with network_info: [{"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:21:52 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-dc98a58f-4530-4863-afcd-1efe79d50b28 req-d0aa663b-be74-4e65-a928-6f6cf6195cc8 service nova] Releasing lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:21:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG os_brick.utils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[23707509-9383-4fa3-aa4a-ad8654b6612a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5632474-25a6-4188-81f6-619a004d51c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a23867-f6ad-41de-9214-c23880e21624]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a72d09-da4a-4fb9-9635-e781fbe78ed4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:21:54 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:21:54 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c83139-a46c-4774-a63c-d8d0549b9162]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG os_brick.utils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:21:54 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Updating existing volume attachment record: df5b0df9-bc5c-4385-93ea-21b062b56b10 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:21:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:21:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:22:01 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Creating image(s)
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Ensure instance console log exists: /opt/stack/data/nova/instances/2427745b-9f48-4d31-a7e5-3a32f9482ff9/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Start _get_guest_xml network_info=[{"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-25T17:21:43Z,direct_url=<?>,disk_format='qcow2',id=85392e3d-0803-4dbd-be37-f19246de5a9d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1895483095',owner='f60ec6ce16624cd8af59a77456e647b9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-25T17:21:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'df5b0df9-bc5c-4385-93ea-21b062b56b10', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfawxHqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2427745b-9f48-4d31-a7e5-3a32f9482ff9', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0c91673-e554-4f2b-9614-3d75892bf964', 'serial': 'c0c91673-e554-4f2b-9614-3d75892bf964'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:22:01 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:22:01 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-25T17:21:43Z,direct_url=<?>,disk_format='qcow2',id=85392e3d-0803-4dbd-be37-f19246de5a9d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1895483095',owner='f60ec6ce16624cd8af59a77456e647b9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-25T17:21:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfawxHqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:22:01 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:22:01 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:22:01 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[368c04eb-32d4-49bd-bfca-e3d9e57b3dcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:22:01 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b0fa7-848f-4eed-8f5d-be296a688682]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964] added
Jul 25 17:22:01 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f07bba-e1b4-49cb-a0d8-69e748562169]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ab3d40-c452-4df7-904c-e3d13f697dcd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfawxHqh {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfawxHqh" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd21968-ba15-450d-9c22-61a3ab3e6a44]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kfawxHqh'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad24779a-a41c-4690-98c8-1875f6dbb99e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ee9c91-667a-4f86-8678-35eadb4d1064]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:22:01 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:22:01 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d78cb66-86ab-4e87-b4be-d7293a9ee57c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964, portal: 172.16.0.220,3260]
Jul 25 17:22:01 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964, portal: 172.16.0.220,3260] successful.
Jul 25 17:22:01 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[989d1dcd-2b90-42c0-9226-68b952bbeaef]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b00e8c-94dc-49d6-821d-66c2151a4254]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:22:01 user nova-compute[70659]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 (non-flash)
Jul 25 17:22:01 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:22:01 user nova-compute[70659]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 (non-flash)
Jul 25 17:22:01 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bb58fd-67f1-4f77-ab9f-4334d8a489f5]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:22:01 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfawxHqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23836343739306561', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836343739306561', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1871223966',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1871223966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1871223966',id=48,image_ref='85392e3d-0803-4dbd-be37-f19246de5a9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0fDnAzkZ8FUuqMUAbrWIxp9Vbbr5LHrJ//rN75CCzh4R8lecmyPRWk2o3eErU/4PgPrJUtg/IdqcI7InAKz34iAEAoKc/mewFe1MlO0vjgoBppneKlDeLdjYsO9onUOw==',key_name='tempest-keypair-648240805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-cuu38rr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1024566986',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=2427745b-9f48-4d31-a7e5-3a32f9482ff9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=05032eba-3cc7-452e-89bd-20e9af0e4570,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05032eba-3c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.objects.instance [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'pci_devices' on Instance uuid 2427745b-9f48-4d31-a7e5-3a32f9482ff9 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:22:02 user nova-compute[70659]:   <uuid>2427745b-9f48-4d31-a7e5-3a32f9482ff9</uuid>
Jul 25 17:22:02 user nova-compute[70659]:   <name>instance-00000030</name>
Jul 25 17:22:02 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:22:02 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:22:02 user nova-compute[70659]:   <metadata>
Jul 25 17:22:02 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:22:02 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:22:02 user nova-compute[70659]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1871223966</nova:name>
Jul 25 17:22:02 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:22:01</nova:creationTime>
Jul 25 17:22:02 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:22:02 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:22:02 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:22:02 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:22:02 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:22:02 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:22:02 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:22:02 user nova-compute[70659]:       <nova:owner>
Jul 25 17:22:02 user nova-compute[70659]:         <nova:user uuid="80d4bea31bd94de88d07d0b7bae77086">tempest-TestVolumeBootPattern-1024566986-project-member</nova:user>
Jul 25 17:22:02 user nova-compute[70659]:         <nova:project uuid="f60ec6ce16624cd8af59a77456e647b9">tempest-TestVolumeBootPattern-1024566986</nova:project>
Jul 25 17:22:02 user nova-compute[70659]:       </nova:owner>
Jul 25 17:22:02 user nova-compute[70659]:       <nova:root type="image" uuid="85392e3d-0803-4dbd-be37-f19246de5a9d"/>
Jul 25 17:22:02 user nova-compute[70659]:       <nova:ports>
Jul 25 17:22:02 user nova-compute[70659]:         <nova:port uuid="05032eba-3cc7-452e-89bd-20e9af0e4570">
Jul 25 17:22:02 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 17:22:02 user nova-compute[70659]:         </nova:port>
Jul 25 17:22:02 user nova-compute[70659]:       </nova:ports>
Jul 25 17:22:02 user nova-compute[70659]:     </nova:instance>
Jul 25 17:22:02 user nova-compute[70659]:   </metadata>
Jul 25 17:22:02 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:22:02 user nova-compute[70659]:     <system>
Jul 25 17:22:02 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:22:02 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:22:02 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:22:02 user nova-compute[70659]:       <entry name="serial">2427745b-9f48-4d31-a7e5-3a32f9482ff9</entry>
Jul 25 17:22:02 user nova-compute[70659]:       <entry name="uuid">2427745b-9f48-4d31-a7e5-3a32f9482ff9</entry>
Jul 25 17:22:02 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:22:02 user nova-compute[70659]:     </system>
Jul 25 17:22:02 user nova-compute[70659]:   </sysinfo>
Jul 25 17:22:02 user nova-compute[70659]:   <os>
Jul 25 17:22:02 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:22:02 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:22:02 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:22:02 user nova-compute[70659]:   </os>
Jul 25 17:22:02 user nova-compute[70659]:   <features>
Jul 25 17:22:02 user nova-compute[70659]:     <acpi/>
Jul 25 17:22:02 user nova-compute[70659]:     <apic/>
Jul 25 17:22:02 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:22:02 user nova-compute[70659]:   </features>
Jul 25 17:22:02 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:22:02 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:22:02 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:22:02 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:22:02 user nova-compute[70659]:   </clock>
Jul 25 17:22:02 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:22:02 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:22:02 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:22:02 user nova-compute[70659]:   </cpu>
Jul 25 17:22:02 user nova-compute[70659]:   <devices>
Jul 25 17:22:02 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:22:02 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:22:02 user nova-compute[70659]:       <source dev="/dev/sdc"/>
Jul 25 17:22:02 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:22:02 user nova-compute[70659]:       <serial>c0c91673-e554-4f2b-9614-3d75892bf964</serial>
Jul 25 17:22:02 user nova-compute[70659]:     </disk>
Jul 25 17:22:02 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:22:02 user nova-compute[70659]:       <mac address="fa:16:3e:76:6f:96"/>
Jul 25 17:22:02 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:22:02 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:22:02 user nova-compute[70659]:       <target dev="tap05032eba-3c"/>
Jul 25 17:22:02 user nova-compute[70659]:     </interface>
Jul 25 17:22:02 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:22:02 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/2427745b-9f48-4d31-a7e5-3a32f9482ff9/console.log" append="off"/>
Jul 25 17:22:02 user nova-compute[70659]:     </serial>
Jul 25 17:22:02 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:22:02 user nova-compute[70659]:     <video>
Jul 25 17:22:02 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:22:02 user nova-compute[70659]:     </video>
Jul 25 17:22:02 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:22:02 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:22:02 user nova-compute[70659]:     </rng>
Jul 25 17:22:02 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:22:02 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:22:02 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:22:02 user nova-compute[70659]:     </memballoon>
Jul 25 17:22:02 user nova-compute[70659]:   </devices>
Jul 25 17:22:02 user nova-compute[70659]: </domain>
Jul 25 17:22:02 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1871223966',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1871223966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1871223966',id=48,image_ref='85392e3d-0803-4dbd-be37-f19246de5a9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0fDnAzkZ8FUuqMUAbrWIxp9Vbbr5LHrJ//rN75CCzh4R8lecmyPRWk2o3eErU/4PgPrJUtg/IdqcI7InAKz34iAEAoKc/mewFe1MlO0vjgoBppneKlDeLdjYsO9onUOw==',key_name='tempest-keypair-648240805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-cuu38rr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1024566986',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=2427745b-9f48-4d31-a7e5-3a32f9482ff9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=05032eba-3cc7-452e-89bd-20e9af0e4570,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05032eba-3c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG os_vif [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=05032eba-3cc7-452e-89bd-20e9af0e4570,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05032eba-3c') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05032eba-3c, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05032eba-3c, col_values=(('external_ids', {'iface-id': '05032eba-3cc7-452e-89bd-20e9af0e4570', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:6f:96', 'vm-uuid': '2427745b-9f48-4d31-a7e5-3a32f9482ff9'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:02 user nova-compute[70659]: INFO os_vif [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=05032eba-3cc7-452e-89bd-20e9af0e4570,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05032eba-3c')
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:22:02 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No VIF found with MAC fa:16:3e:76:6f:96, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-ccd3078a-f5a3-473f-82fd-16af4dce0e17 req-1b12418c-42a9-4008-bedf-f75faa40a843 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received event network-vif-plugged-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ccd3078a-f5a3-473f-82fd-16af4dce0e17 req-1b12418c-42a9-4008-bedf-f75faa40a843 service nova] Acquiring lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ccd3078a-f5a3-473f-82fd-16af4dce0e17 req-1b12418c-42a9-4008-bedf-f75faa40a843 service nova] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-ccd3078a-f5a3-473f-82fd-16af4dce0e17 req-1b12418c-42a9-4008-bedf-f75faa40a843 service nova] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG nova.compute.manager [req-ccd3078a-f5a3-473f-82fd-16af4dce0e17 req-1b12418c-42a9-4008-bedf-f75faa40a843 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] No waiting events found dispatching network-vif-plugged-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:22:03 user nova-compute[70659]: WARNING nova.compute.manager [req-ccd3078a-f5a3-473f-82fd-16af4dce0e17 req-1b12418c-42a9-4008-bedf-f75faa40a843 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received unexpected event network-vif-plugged-05032eba-3cc7-452e-89bd-20e9af0e4570 for instance with vm_state building and task_state spawning.
Jul 25 17:22:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305725.7832515, 2427745b-9f48-4d31-a7e5-3a32f9482ff9 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:22:05 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] VM Resumed (Lifecycle Event)
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:22:05 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Instance spawned successfully.
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:22:05 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305725.7846146, 2427745b-9f48-4d31-a7e5-3a32f9482ff9 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:22:05 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] VM Started (Lifecycle Event)
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:22:05 user nova-compute[70659]: INFO nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Took 4.88 seconds to spawn the instance on the hypervisor.
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:22:05 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-c563a36e-fbbe-414b-8745-9c08aef9709e req-e8b7b9c9-3e11-406a-968d-e20922a365af service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received event network-vif-plugged-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c563a36e-fbbe-414b-8745-9c08aef9709e req-e8b7b9c9-3e11-406a-968d-e20922a365af service nova] Acquiring lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c563a36e-fbbe-414b-8745-9c08aef9709e req-e8b7b9c9-3e11-406a-968d-e20922a365af service nova] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c563a36e-fbbe-414b-8745-9c08aef9709e req-e8b7b9c9-3e11-406a-968d-e20922a365af service nova] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:22:05 user nova-compute[70659]: DEBUG nova.compute.manager [req-c563a36e-fbbe-414b-8745-9c08aef9709e req-e8b7b9c9-3e11-406a-968d-e20922a365af service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] No waiting events found dispatching network-vif-plugged-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:22:05 user nova-compute[70659]: WARNING nova.compute.manager [req-c563a36e-fbbe-414b-8745-9c08aef9709e req-e8b7b9c9-3e11-406a-968d-e20922a365af service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received unexpected event network-vif-plugged-05032eba-3cc7-452e-89bd-20e9af0e4570 for instance with vm_state building and task_state spawning.
Jul 25 17:22:06 user nova-compute[70659]: INFO nova.compute.manager [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Took 17.56 seconds to build instance.
Jul 25 17:22:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-eddcbdcc-a05a-4016-be7e-d328c6bef8a1 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.675s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:22:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:22:15 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:22:15 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8669MB free_disk=25.177814483642578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 83ac4412-e463-4f01-99c9-53a437fb1c0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 2427745b-9f48-4d31-a7e5-3a32f9482ff9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:22:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:22:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:22:18 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:22 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:22:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:22:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:22:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:22:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:22:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid 83ac4412-e463-4f01-99c9-53a437fb1c0c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updating instance_info_cache with network_info: [{"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:22:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:22:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 17:22:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:22:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:22:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:22:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:22:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:22:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:22:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:22:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:22:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:22:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:22:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:22:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:22:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:22:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:23:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:23:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:08 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:23:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:17 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:23:17 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8748MB free_disk=25.177143096923828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 83ac4412-e463-4f01-99c9-53a437fb1c0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 2427745b-9f48-4d31-a7e5-3a32f9482ff9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:23:17 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 17:23:18 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 17:23:18 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 17:23:18 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 17:23:18 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 17:23:18 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:23:18 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:23:18 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:23:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:23:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:22 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:23:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:24 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:23:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:23:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:23:25 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:23:25 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Updating instance_info_cache with network_info: [{"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:23:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:23:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 83ac4412-e463-4f01-99c9-53a437fb1c0c {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Triggering sync for uuid 2427745b-9f48-4d31-a7e5-3a32f9482ff9 {{(pid=70659) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:23:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:23:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-50311fbb-1f05-4323-8b84-2bd4314d270a req-97bb97ac-0752-4a84-b2ba-a96cededbf09 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received event network-changed-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:23:39 user nova-compute[70659]: DEBUG nova.compute.manager [req-50311fbb-1f05-4323-8b84-2bd4314d270a req-97bb97ac-0752-4a84-b2ba-a96cededbf09 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Refreshing instance network info cache due to event network-changed-05032eba-3cc7-452e-89bd-20e9af0e4570. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:23:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50311fbb-1f05-4323-8b84-2bd4314d270a req-97bb97ac-0752-4a84-b2ba-a96cededbf09 service nova] Acquiring lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:23:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50311fbb-1f05-4323-8b84-2bd4314d270a req-97bb97ac-0752-4a84-b2ba-a96cededbf09 service nova] Acquired lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:23:39 user nova-compute[70659]: DEBUG nova.network.neutron [req-50311fbb-1f05-4323-8b84-2bd4314d270a req-97bb97ac-0752-4a84-b2ba-a96cededbf09 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Refreshing network info cache for port 05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:23:40 user nova-compute[70659]: INFO nova.compute.manager [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Terminating instance
Jul 25 17:23:40 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG nova.network.neutron [req-50311fbb-1f05-4323-8b84-2bd4314d270a req-97bb97ac-0752-4a84-b2ba-a96cededbf09 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Updated VIF entry in instance network info cache for port 05032eba-3cc7-452e-89bd-20e9af0e4570. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG nova.network.neutron [req-50311fbb-1f05-4323-8b84-2bd4314d270a req-97bb97ac-0752-4a84-b2ba-a96cededbf09 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Updating instance_info_cache with network_info: [{"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-50311fbb-1f05-4323-8b84-2bd4314d270a req-97bb97ac-0752-4a84-b2ba-a96cededbf09 service nova] Releasing lock "refresh_cache-2427745b-9f48-4d31-a7e5-3a32f9482ff9" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-8076e04f-7fba-4aef-b0ac-ceab40cede35 req-ea2e7bcf-accb-4d6d-a900-d5004752b456 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received event network-vif-unplugged-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8076e04f-7fba-4aef-b0ac-ceab40cede35 req-ea2e7bcf-accb-4d6d-a900-d5004752b456 service nova] Acquiring lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8076e04f-7fba-4aef-b0ac-ceab40cede35 req-ea2e7bcf-accb-4d6d-a900-d5004752b456 service nova] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8076e04f-7fba-4aef-b0ac-ceab40cede35 req-ea2e7bcf-accb-4d6d-a900-d5004752b456 service nova] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-8076e04f-7fba-4aef-b0ac-ceab40cede35 req-ea2e7bcf-accb-4d6d-a900-d5004752b456 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] No waiting events found dispatching network-vif-unplugged-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG nova.compute.manager [req-8076e04f-7fba-4aef-b0ac-ceab40cede35 req-ea2e7bcf-accb-4d6d-a900-d5004752b456 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received event network-vif-unplugged-05032eba-3cc7-452e-89bd-20e9af0e4570 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Instance destroyed successfully.
Jul 25 17:23:41 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'resources' on Instance uuid 2427745b-9f48-4d31-a7e5-3a32f9482ff9 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1871223966',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1871223966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1871223966',id=48,image_ref='85392e3d-0803-4dbd-be37-f19246de5a9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0fDnAzkZ8FUuqMUAbrWIxp9Vbbr5LHrJ//rN75CCzh4R8lecmyPRWk2o3eErU/4PgPrJUtg/IdqcI7InAKz34iAEAoKc/mewFe1MlO0vjgoBppneKlDeLdjYsO9onUOw==',key_name='tempest-keypair-648240805',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-cuu38rr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1024566986',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=2427745b-9f48-4d31-a7e5-3a32f9482ff9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "05032eba-3cc7-452e-89bd-20e9af0e4570", "address": "fa:16:3e:76:6f:96", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05032eba-3c", "ovs_interfaceid": "05032eba-3cc7-452e-89bd-20e9af0e4570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=05032eba-3cc7-452e-89bd-20e9af0e4570,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05032eba-3c') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_vif [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=05032eba-3cc7-452e-89bd-20e9af0e4570,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05032eba-3c') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05032eba-3c, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:41 user nova-compute[70659]: INFO os_vif [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=05032eba-3cc7-452e-89bd-20e9af0e4570,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05032eba-3c')
Jul 25 17:23:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfawxHqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:23:41 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a8b726-5120-4b2d-a7ca-87ca3ab9dd24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e971c65c-b655-4ce3-b899-d9a95aa7de99]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:23:41 user nova-compute[70659]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 (non-flash)
Jul 25 17:23:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:23:41 user nova-compute[70659]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 (non-flash)
Jul 25 17:23:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd1069bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964'): ({'sdc'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Removing single pathed devices sdc {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2500113-93c2-4ef1-902c-426f0ef2f67e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3304053-04fe-4bd1-8f31-dbf341db32e0]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flushing IO for device /dev/sdc {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dcbe6e-1dfd-4db2-b92e-1c45a86d1be2]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4e002c-9bbf-42bf-85d4-f10211617cb4]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd417c4a8-864790eacb4f8a4b', '/dev/disk/by-id/scsi-23836343739306561', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d417c4a8') {{(pid=81811) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[693b82e9-882c-42c9-8d0a-ca17b1a7e109]: (4, None) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2223331-1ccb-4ba5-bcb7-e4d83d630d32]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f4bdaa-56b4-4d60-ab2a-2b7256c922ef]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964, portal: 172.16.0.220,3260]
Jul 25 17:23:41 user nova-compute[70659]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964, portal: 172.16.0.220,3260] successful.
Jul 25 17:23:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c91673-e554-4f2b-9614-3d75892bf964 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7a15ee-4a4a-4cad-aa19-a917f81d4e2d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== disconnect_volume: return (266ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:23:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Deleting instance files /opt/stack/data/nova/instances/2427745b-9f48-4d31-a7e5-3a32f9482ff9_del
Jul 25 17:23:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Deletion of /opt/stack/data/nova/instances/2427745b-9f48-4d31-a7e5-3a32f9482ff9_del complete
Jul 25 17:23:41 user nova-compute[70659]: INFO nova.compute.manager [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 25 17:23:41 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:23:41 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:23:42 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:23:42 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Took 0.95 seconds to deallocate network for instance.
Jul 25 17:23:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-87b11bba-f382-40f5-ab3b-5d44a3b4f8e3 req-226525b7-9986-4135-a7f5-4f85955f4f13 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received event network-vif-plugged-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:23:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-87b11bba-f382-40f5-ab3b-5d44a3b4f8e3 req-226525b7-9986-4135-a7f5-4f85955f4f13 service nova] Acquiring lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:23:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-87b11bba-f382-40f5-ab3b-5d44a3b4f8e3 req-226525b7-9986-4135-a7f5-4f85955f4f13 service nova] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:23:42 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-87b11bba-f382-40f5-ab3b-5d44a3b4f8e3 req-226525b7-9986-4135-a7f5-4f85955f4f13 service nova] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:23:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-87b11bba-f382-40f5-ab3b-5d44a3b4f8e3 req-226525b7-9986-4135-a7f5-4f85955f4f13 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] No waiting events found dispatching network-vif-plugged-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:23:42 user nova-compute[70659]: WARNING nova.compute.manager [req-87b11bba-f382-40f5-ab3b-5d44a3b4f8e3 req-226525b7-9986-4135-a7f5-4f85955f4f13 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received unexpected event network-vif-plugged-05032eba-3cc7-452e-89bd-20e9af0e4570 for instance with vm_state active and task_state deleting.
Jul 25 17:23:42 user nova-compute[70659]: DEBUG nova.compute.manager [req-87b11bba-f382-40f5-ab3b-5d44a3b4f8e3 req-226525b7-9986-4135-a7f5-4f85955f4f13 service nova] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Received event network-vif-deleted-05032eba-3cc7-452e-89bd-20e9af0e4570 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:23:43 user nova-compute[70659]: INFO nova.compute.manager [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Took 0.72 seconds to detach 1 volumes for instance.
Jul 25 17:23:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Deleting volume: c0c91673-e554-4f2b-9614-3d75892bf964 {{(pid=70659) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 17:23:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:23:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:23:43 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:23:43 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:23:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:23:43 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Deleted allocations for instance 2427745b-9f48-4d31-a7e5-3a32f9482ff9
Jul 25 17:23:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7aa2f315-5e5c-4fa1-b763-2bc09c7bd8eb tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "2427745b-9f48-4d31-a7e5-3a32f9482ff9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.153s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:23:46 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:23:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:23:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:23:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:23:56 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305821.0256283, 2427745b-9f48-4d31-a7e5-3a32f9482ff9 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:23:56 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] VM Stopped (Lifecycle Event)
Jul 25 17:23:56 user nova-compute[70659]: DEBUG nova.compute.manager [None req-cd4ac2dc-e23a-49cf-8e65-1e696fd0720f None None] [instance: 2427745b-9f48-4d31-a7e5-3a32f9482ff9] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:23:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:01 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:06 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:16 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:24:19 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:24:19 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.176231384277344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 83ac4412-e463-4f01-99c9-53a437fb1c0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:24:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:21 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:23 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:24 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:26 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:24:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:24:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:24:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:24:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:24:27 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:24:27 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid 83ac4412-e463-4f01-99c9-53a437fb1c0c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:24:28 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updating instance_info_cache with network_info: [{"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:24:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-83ac4412-e463-4f01-99c9-53a437fb1c0c" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:24:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:24:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:34 user nova-compute[70659]: INFO nova.compute.manager [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Terminating instance
Jul 25 17:24:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-c84f09bc-7cb0-488d-bd6e-fc8a9bf17807 req-568dc1fa-bdf6-46ba-bfb1-6066bbd5a629 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-unplugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c84f09bc-7cb0-488d-bd6e-fc8a9bf17807 req-568dc1fa-bdf6-46ba-bfb1-6066bbd5a629 service nova] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c84f09bc-7cb0-488d-bd6e-fc8a9bf17807 req-568dc1fa-bdf6-46ba-bfb1-6066bbd5a629 service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c84f09bc-7cb0-488d-bd6e-fc8a9bf17807 req-568dc1fa-bdf6-46ba-bfb1-6066bbd5a629 service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-c84f09bc-7cb0-488d-bd6e-fc8a9bf17807 req-568dc1fa-bdf6-46ba-bfb1-6066bbd5a629 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] No waiting events found dispatching network-vif-unplugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG nova.compute.manager [req-c84f09bc-7cb0-488d-bd6e-fc8a9bf17807 req-568dc1fa-bdf6-46ba-bfb1-6066bbd5a629 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-unplugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Instance destroyed successfully.
Jul 25 17:24:35 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'resources' on Instance uuid 83ac4412-e463-4f01-99c9-53a437fb1c0c {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-503899803',display_name='tempest-TestVolumeBootPattern-volume-backed-server-503899803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-503899803',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH87EPsAgHS6TnX88VoCvj1V7mblLYnKJ+bfWJMK8pAGLC3k7uzKrsumgQtddaLz886K1eCTMt3QQD+xHk3afou/Z0kI/6tkZNSfk8RdRrXZ77r05bixn4QvASWbEClP8A==',key_name='tempest-keypair-1668430560',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:20:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-xhk6lx0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=83ac4412-e463-4f01-99c9-53a437fb1c0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "address": "fa:16:3e:35:b9:07", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35d6f99-3d", "ovs_interfaceid": "f35d6f99-3d43-4258-9486-8a31893fa0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:b9:07,bridge_name='br-int',has_traffic_filtering=True,id=f35d6f99-3d43-4258-9486-8a31893fa0d0,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35d6f99-3d') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_vif [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:b9:07,bridge_name='br-int',has_traffic_filtering=True,id=f35d6f99-3d43-4258-9486-8a31893fa0d0,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35d6f99-3d') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf35d6f99-3d, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:35 user nova-compute[70659]: INFO os_vif [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:b9:07,bridge_name='br-int',has_traffic_filtering=True,id=f35d6f99-3d43-4258-9486-8a31893fa0d0,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35d6f99-3d')
Jul 25 17:24:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgmqtKwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:24:35 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ff8e8f-82e8-469f-8062-114bb5ab45bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c82dc0-016a-4479-882c-11cfa002ab7f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:24:35 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 (non-flash)
Jul 25 17:24:35 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd301f1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa2b50-1026-43fd-ad50-d5d22d19665c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[42583271-54f1-42e2-b480-876c5c781337]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a6661e-4248-48ca-8250-deb3bb89cf3d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b744d83-9100-4125-8bf7-85d51f9cac6c]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a03439-dbe4-483d-906a-c8e613e2cf7e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[202b0f1c-a601-4c73-855c-49ea8990c433]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88, portal: 172.16.0.220,3260]
Jul 25 17:24:35 user nova-compute[70659]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88, portal: 172.16.0.220,3260] successful.
Jul 25 17:24:35 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ff6e299-a244-41f9-8d71-f3da986e4a88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceab874d-f9ed-4769-ab68-bbc04188b836]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== disconnect_volume: return (294ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:24:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Deleting instance files /opt/stack/data/nova/instances/83ac4412-e463-4f01-99c9-53a437fb1c0c_del
Jul 25 17:24:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Deletion of /opt/stack/data/nova/instances/83ac4412-e463-4f01-99c9-53a437fb1c0c_del complete
Jul 25 17:24:35 user nova-compute[70659]: INFO nova.compute.manager [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 25 17:24:35 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:24:36 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Took 1.19 seconds to deallocate network for instance.
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-b6f6a7ac-02de-4b73-a862-c116507801b7 req-d85ebe76-617b-419a-ac6f-bd14c44655e0 service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-deleted-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] No waiting events found dispatching network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:24:36 user nova-compute[70659]: WARNING nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received unexpected event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 for instance with vm_state active and task_state deleting.
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] No waiting events found dispatching network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:24:36 user nova-compute[70659]: WARNING nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received unexpected event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 for instance with vm_state active and task_state deleting.
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] No waiting events found dispatching network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:24:36 user nova-compute[70659]: WARNING nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received unexpected event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 for instance with vm_state active and task_state deleting.
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-unplugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] No waiting events found dispatching network-vif-unplugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-unplugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Acquiring lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:36 user nova-compute[70659]: DEBUG nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] No waiting events found dispatching network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:24:36 user nova-compute[70659]: WARNING nova.compute.manager [req-729dba12-3e53-4edc-81ac-2bf6ba524ca2 req-d174e486-2e51-48f5-847d-6c78311a808d service nova] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Received unexpected event network-vif-plugged-f35d6f99-3d43-4258-9486-8a31893fa0d0 for instance with vm_state active and task_state deleting.
Jul 25 17:24:37 user nova-compute[70659]: INFO nova.compute.manager [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Took 0.84 seconds to detach 1 volumes for instance.
Jul 25 17:24:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Deleting volume: 0ff6e299-a244-41f9-8d71-f3da986e4a88 {{(pid=70659) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 17:24:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:24:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:24:37 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:24:37 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:24:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:37 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Deleted allocations for instance 83ac4412-e463-4f01-99c9-53a437fb1c0c
Jul 25 17:24:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4476cc0a-4b7b-4c0d-b771-1cb32deb98db tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "83ac4412-e463-4f01-99c9-53a437fb1c0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.580s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:24:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:24:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:24:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:24:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:50 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690305875.0337353, 83ac4412-e463-4f01-99c9-53a437fb1c0c => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:24:50 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] VM Stopped (Lifecycle Event)
Jul 25 17:24:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ff9b2f70-09c5-4698-ae8f-034e2b8b5d53 None None] [instance: 83ac4412-e463-4f01-99c9-53a437fb1c0c] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:24:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:24:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:24:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:24:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:24:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:24:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:25:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:25:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:25:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:25:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:25:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:25:20 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:25:20 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:25:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.17523956298828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:25:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:25:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:25:23 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:25:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:25:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:26 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:25:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:25:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:25:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:25:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 17:25:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:25:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:25:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:25:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:25:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:25:34 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:25:34 user nova-compute[70659]: INFO nova.compute.claims [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Claim successful on node user
Jul 25 17:25:34 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG nova.network.neutron [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:25:35 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:25:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:25:35 user nova-compute[70659]: INFO nova.virt.block_device [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Booting with volume f4666ea5-b543-4205-8461-d5fa4edb1e09 at /dev/vda
Jul 25 17:25:35 user nova-compute[70659]: DEBUG nova.policy [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80d4bea31bd94de88d07d0b7bae77086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ec6ce16624cd8af59a77456e647b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG os_brick.utils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a406afdc-659d-4350-83e4-5c527095e982]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6124e3b4-726b-46c6-96bf-759541626ed7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[157fc297-37a3-4f37-a0e9-d1d5c99665e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e1710d-8851-4c6a-b4b9-3e6a1f31e543]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:25:35 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:25:35 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b28577-f8d2-4a90-9f21-6cc97b83918c]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG os_brick.utils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:25:35 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Updating existing volume attachment record: a40c2f0e-a116-462c-9bda-a348e82a38d3 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:25:36 user nova-compute[70659]: DEBUG nova.network.neutron [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Successfully created port: e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Successfully updated port: e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquired lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-affc7fa5-8edf-473e-b8ea-8430f89bace4 req-d4933a72-c34e-416e-b651-b9204897ba8f service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received event network-changed-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG nova.compute.manager [req-affc7fa5-8edf-473e-b8ea-8430f89bace4 req-d4933a72-c34e-416e-b651-b9204897ba8f service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Refreshing instance network info cache due to event network-changed-e1998b4f-bea6-44b4-93cb-c683fff1fb2e. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-affc7fa5-8edf-473e-b8ea-8430f89bace4 req-d4933a72-c34e-416e-b651-b9204897ba8f service nova] Acquiring lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Updating instance_info_cache with network_info: [{"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Releasing lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Instance network_info: |[{"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-affc7fa5-8edf-473e-b8ea-8430f89bace4 req-d4933a72-c34e-416e-b651-b9204897ba8f service nova] Acquired lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:25:37 user nova-compute[70659]: DEBUG nova.network.neutron [req-affc7fa5-8edf-473e-b8ea-8430f89bace4 req-d4933a72-c34e-416e-b651-b9204897ba8f service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Refreshing network info cache for port e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:25:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-affc7fa5-8edf-473e-b8ea-8430f89bace4 req-d4933a72-c34e-416e-b651-b9204897ba8f service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Updated VIF entry in instance network info cache for port e1998b4f-bea6-44b4-93cb-c683fff1fb2e. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:25:38 user nova-compute[70659]: DEBUG nova.network.neutron [req-affc7fa5-8edf-473e-b8ea-8430f89bace4 req-d4933a72-c34e-416e-b651-b9204897ba8f service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Updating instance_info_cache with network_info: [{"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:25:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-affc7fa5-8edf-473e-b8ea-8430f89bace4 req-d4933a72-c34e-416e-b651-b9204897ba8f service nova] Releasing lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:25:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:25:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:25:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:25:41 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Creating image(s)
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Ensure instance console log exists: /opt/stack/data/nova/instances/8aa7f902-5046-4728-9c40-b3e29f5b5c2b/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Start _get_guest_xml network_info=[{"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a40c2f0e-a116-462c-9bda-a348e82a38d3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsFpuSkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8aa7f902-5046-4728-9c40-b3e29f5b5c2b', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4666ea5-b543-4205-8461-d5fa4edb1e09', 'serial': 'f4666ea5-b543-4205-8461-d5fa4edb1e09'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:25:41 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:25:41 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsFpuSkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:25:41 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:25:41 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:25:41 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5033977d-6882-4963-9882-2c989d1a4be9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:25:41 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6bcc3-acd4-4872-bc84-b34e7bc4b7b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09] added
Jul 25 17:25:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[481c57aa-f65a-470d-9e47-190b47bd620d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fe6888-40f2-440a-ac0e-f18ea098c51a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsFpuSkm {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsFpuSkm" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2489585b-c39d-444d-871d-5a7f06a892bf]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BsFpuSkm'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5200357c-7421-4dd3-b61a-745f138dea62]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ffd32-0266-43f4-82c6-baf7cecad65a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:25:41 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:25:41 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:25:41 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 17:25:41 user nova-compute[70659]: 
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ccd790-a661-4cde-a56f-a349aeeccab1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260]
Jul 25 17:25:41 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260] successful.
Jul 25 17:25:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e419e3-c8f4-4abe-89a4-a9d45acc82f9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[07959db5-0f7c-4f19-84ab-be4a51b0df81]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:25:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:25:41 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5918f609-adb1-408f-a3c8-92dac247c392]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:25:41 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsFpuSkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26335666165393534', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335666165393534', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:25:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1263880360',display_name='tempest-TestVolumeBootPattern-server-1263880360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1263880360',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7QC9uQNcrFBBHhXb6+i8aDbLy+AmkigPFGq2n70Q94ElSP++KO63c8If7gMAeO1JcU0nisu+1PGDE2+JJPvX/ZM3iLaeFqNAR6ful0rfkF02TtegfxcAlURif+gavTIA==',key_name='tempest-TestVolumeBootPattern-228752096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-mn09cfru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:25:35Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=8aa7f902-5046-4728-9c40-b3e29f5b5c2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d8:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1998b4f-bea6-44b4-93cb-c683fff1fb2e,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1998b4f-be') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG nova.objects.instance [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'pci_devices' on Instance uuid 8aa7f902-5046-4728-9c40-b3e29f5b5c2b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:25:42 user nova-compute[70659]:   <uuid>8aa7f902-5046-4728-9c40-b3e29f5b5c2b</uuid>
Jul 25 17:25:42 user nova-compute[70659]:   <name>instance-00000031</name>
Jul 25 17:25:42 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:25:42 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:25:42 user nova-compute[70659]:   <metadata>
Jul 25 17:25:42 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:25:42 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:25:42 user nova-compute[70659]:       <nova:name>tempest-TestVolumeBootPattern-server-1263880360</nova:name>
Jul 25 17:25:42 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:25:41</nova:creationTime>
Jul 25 17:25:42 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:25:42 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:25:42 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:25:42 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:25:42 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:25:42 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:25:42 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:25:42 user nova-compute[70659]:       <nova:owner>
Jul 25 17:25:42 user nova-compute[70659]:         <nova:user uuid="80d4bea31bd94de88d07d0b7bae77086">tempest-TestVolumeBootPattern-1024566986-project-member</nova:user>
Jul 25 17:25:42 user nova-compute[70659]:         <nova:project uuid="f60ec6ce16624cd8af59a77456e647b9">tempest-TestVolumeBootPattern-1024566986</nova:project>
Jul 25 17:25:42 user nova-compute[70659]:       </nova:owner>
Jul 25 17:25:42 user nova-compute[70659]:       <nova:ports>
Jul 25 17:25:42 user nova-compute[70659]:         <nova:port uuid="e1998b4f-bea6-44b4-93cb-c683fff1fb2e">
Jul 25 17:25:42 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 17:25:42 user nova-compute[70659]:         </nova:port>
Jul 25 17:25:42 user nova-compute[70659]:       </nova:ports>
Jul 25 17:25:42 user nova-compute[70659]:     </nova:instance>
Jul 25 17:25:42 user nova-compute[70659]:   </metadata>
Jul 25 17:25:42 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:25:42 user nova-compute[70659]:     <system>
Jul 25 17:25:42 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:25:42 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:25:42 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:25:42 user nova-compute[70659]:       <entry name="serial">8aa7f902-5046-4728-9c40-b3e29f5b5c2b</entry>
Jul 25 17:25:42 user nova-compute[70659]:       <entry name="uuid">8aa7f902-5046-4728-9c40-b3e29f5b5c2b</entry>
Jul 25 17:25:42 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:25:42 user nova-compute[70659]:     </system>
Jul 25 17:25:42 user nova-compute[70659]:   </sysinfo>
Jul 25 17:25:42 user nova-compute[70659]:   <os>
Jul 25 17:25:42 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:25:42 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:25:42 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:25:42 user nova-compute[70659]:   </os>
Jul 25 17:25:42 user nova-compute[70659]:   <features>
Jul 25 17:25:42 user nova-compute[70659]:     <acpi/>
Jul 25 17:25:42 user nova-compute[70659]:     <apic/>
Jul 25 17:25:42 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:25:42 user nova-compute[70659]:   </features>
Jul 25 17:25:42 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:25:42 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:25:42 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:25:42 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:25:42 user nova-compute[70659]:   </clock>
Jul 25 17:25:42 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:25:42 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:25:42 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:25:42 user nova-compute[70659]:   </cpu>
Jul 25 17:25:42 user nova-compute[70659]:   <devices>
Jul 25 17:25:42 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:25:42 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:25:42 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 17:25:42 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:25:42 user nova-compute[70659]:       <serial>f4666ea5-b543-4205-8461-d5fa4edb1e09</serial>
Jul 25 17:25:42 user nova-compute[70659]:     </disk>
Jul 25 17:25:42 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:25:42 user nova-compute[70659]:       <mac address="fa:16:3e:21:d8:fe"/>
Jul 25 17:25:42 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:25:42 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:25:42 user nova-compute[70659]:       <target dev="tape1998b4f-be"/>
Jul 25 17:25:42 user nova-compute[70659]:     </interface>
Jul 25 17:25:42 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:25:42 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/8aa7f902-5046-4728-9c40-b3e29f5b5c2b/console.log" append="off"/>
Jul 25 17:25:42 user nova-compute[70659]:     </serial>
Jul 25 17:25:42 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:25:42 user nova-compute[70659]:     <video>
Jul 25 17:25:42 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:25:42 user nova-compute[70659]:     </video>
Jul 25 17:25:42 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:25:42 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:25:42 user nova-compute[70659]:     </rng>
Jul 25 17:25:42 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:25:42 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:25:42 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:25:42 user nova-compute[70659]:     </memballoon>
Jul 25 17:25:42 user nova-compute[70659]:   </devices>
Jul 25 17:25:42 user nova-compute[70659]: </domain>
Jul 25 17:25:42 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:25:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1263880360',display_name='tempest-TestVolumeBootPattern-server-1263880360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1263880360',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7QC9uQNcrFBBHhXb6+i8aDbLy+AmkigPFGq2n70Q94ElSP++KO63c8If7gMAeO1JcU0nisu+1PGDE2+JJPvX/ZM3iLaeFqNAR6ful0rfkF02TtegfxcAlURif+gavTIA==',key_name='tempest-TestVolumeBootPattern-228752096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-mn09cfru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:25:35Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=8aa7f902-5046-4728-9c40-b3e29f5b5c2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d8:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1998b4f-bea6-44b4-93cb-c683fff1fb2e,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1998b4f-be') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG os_vif [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d8:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1998b4f-bea6-44b4-93cb-c683fff1fb2e,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1998b4f-be') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1998b4f-be, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:25:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1998b4f-be, col_values=(('external_ids', {'iface-id': 'e1998b4f-bea6-44b4-93cb-c683fff1fb2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:d8:fe', 'vm-uuid': '8aa7f902-5046-4728-9c40-b3e29f5b5c2b'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:25:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:25:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:43 user nova-compute[70659]: INFO os_vif [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d8:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1998b4f-bea6-44b4-93cb-c683fff1fb2e,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1998b4f-be')
Jul 25 17:25:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:25:43 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No VIF found with MAC fa:16:3e:21:d8:fe, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-99df4038-07b9-490d-bcea-6adca6488681 req-295d03d0-5739-429f-a430-31cf138d8033 service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received event network-vif-plugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-99df4038-07b9-490d-bcea-6adca6488681 req-295d03d0-5739-429f-a430-31cf138d8033 service nova] Acquiring lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-99df4038-07b9-490d-bcea-6adca6488681 req-295d03d0-5739-429f-a430-31cf138d8033 service nova] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-99df4038-07b9-490d-bcea-6adca6488681 req-295d03d0-5739-429f-a430-31cf138d8033 service nova] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG nova.compute.manager [req-99df4038-07b9-490d-bcea-6adca6488681 req-295d03d0-5739-429f-a430-31cf138d8033 service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] No waiting events found dispatching network-vif-plugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:25:44 user nova-compute[70659]: WARNING nova.compute.manager [req-99df4038-07b9-490d-bcea-6adca6488681 req-295d03d0-5739-429f-a430-31cf138d8033 service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received unexpected event network-vif-plugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e for instance with vm_state building and task_state spawning.
Jul 25 17:25:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305946.4422925, 8aa7f902-5046-4728-9c40-b3e29f5b5c2b => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:25:46 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] VM Resumed (Lifecycle Event)
Jul 25 17:25:46 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Instance spawned successfully.
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:25:46 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690305946.444431, 8aa7f902-5046-4728-9c40-b3e29f5b5c2b => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:25:46 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] VM Started (Lifecycle Event)
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:25:46 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:25:46 user nova-compute[70659]: INFO nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Took 4.99 seconds to spawn the instance on the hypervisor.
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-2eedc485-e444-41a8-b1b5-80661704d520 req-6bbbd77d-d0a7-433e-ab13-4eafed029588 service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received event network-vif-plugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2eedc485-e444-41a8-b1b5-80661704d520 req-6bbbd77d-d0a7-433e-ab13-4eafed029588 service nova] Acquiring lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2eedc485-e444-41a8-b1b5-80661704d520 req-6bbbd77d-d0a7-433e-ab13-4eafed029588 service nova] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2eedc485-e444-41a8-b1b5-80661704d520 req-6bbbd77d-d0a7-433e-ab13-4eafed029588 service nova] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:25:46 user nova-compute[70659]: DEBUG nova.compute.manager [req-2eedc485-e444-41a8-b1b5-80661704d520 req-6bbbd77d-d0a7-433e-ab13-4eafed029588 service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] No waiting events found dispatching network-vif-plugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:25:46 user nova-compute[70659]: WARNING nova.compute.manager [req-2eedc485-e444-41a8-b1b5-80661704d520 req-6bbbd77d-d0a7-433e-ab13-4eafed029588 service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received unexpected event network-vif-plugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e for instance with vm_state building and task_state spawning.
Jul 25 17:25:46 user nova-compute[70659]: INFO nova.compute.manager [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Took 11.81 seconds to build instance.
Jul 25 17:25:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-9d661697-a6c4-4031-8250-55e7f1bf8505 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.934s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:25:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:25:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:09 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:14 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:19 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:26:20 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:26:20 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:26:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=25.165180206298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 8aa7f902-5046-4728-9c40-b3e29f5b5c2b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:26:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:26:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:26:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:26:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:26:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:26:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:24 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:26 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:26:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:26:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:26:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:26:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:28 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid 8aa7f902-5046-4728-9c40-b3e29f5b5c2b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Updating instance_info_cache with network_info: [{"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:26:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:26:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:26:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:26:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:26:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:26:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:26:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:26:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:26:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:26:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:26:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:27:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:27:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:10 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 17:27:10 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 17:27:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:14 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:27:22 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:27:22 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:27:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=25.164573669433594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 8aa7f902-5046-4728-9c40-b3e29f5b5c2b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:27:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:27:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:27:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:27:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:27:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:27:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:27:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:26 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-2f90ccee-80e2-4ac1-afcb-36bcc8277d00 req-efa45b73-1a9f-4943-ab20-4de1cf7cb9eb service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received event network-changed-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:27:27 user nova-compute[70659]: DEBUG nova.compute.manager [req-2f90ccee-80e2-4ac1-afcb-36bcc8277d00 req-efa45b73-1a9f-4943-ab20-4de1cf7cb9eb service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Refreshing instance network info cache due to event network-changed-e1998b4f-bea6-44b4-93cb-c683fff1fb2e. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:27:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2f90ccee-80e2-4ac1-afcb-36bcc8277d00 req-efa45b73-1a9f-4943-ab20-4de1cf7cb9eb service nova] Acquiring lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:27:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2f90ccee-80e2-4ac1-afcb-36bcc8277d00 req-efa45b73-1a9f-4943-ab20-4de1cf7cb9eb service nova] Acquired lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:27:27 user nova-compute[70659]: DEBUG nova.network.neutron [req-2f90ccee-80e2-4ac1-afcb-36bcc8277d00 req-efa45b73-1a9f-4943-ab20-4de1cf7cb9eb service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Refreshing network info cache for port e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:27:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-2f90ccee-80e2-4ac1-afcb-36bcc8277d00 req-efa45b73-1a9f-4943-ab20-4de1cf7cb9eb service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Updated VIF entry in instance network info cache for port e1998b4f-bea6-44b4-93cb-c683fff1fb2e. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG nova.network.neutron [req-2f90ccee-80e2-4ac1-afcb-36bcc8277d00 req-efa45b73-1a9f-4943-ab20-4de1cf7cb9eb service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Updating instance_info_cache with network_info: [{"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-2f90ccee-80e2-4ac1-afcb-36bcc8277d00 req-efa45b73-1a9f-4943-ab20-4de1cf7cb9eb service nova] Releasing lock "refresh_cache-8aa7f902-5046-4728-9c40-b3e29f5b5c2b" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:27:28 user nova-compute[70659]: INFO nova.compute.manager [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Terminating instance
Jul 25 17:27:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-996f1e8d-33d2-4c62-9f07-c45d8942c4b2 req-58f5edfb-8a7d-42ce-9cf4-77e538c31be0 service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received event network-vif-unplugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-996f1e8d-33d2-4c62-9f07-c45d8942c4b2 req-58f5edfb-8a7d-42ce-9cf4-77e538c31be0 service nova] Acquiring lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-996f1e8d-33d2-4c62-9f07-c45d8942c4b2 req-58f5edfb-8a7d-42ce-9cf4-77e538c31be0 service nova] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-996f1e8d-33d2-4c62-9f07-c45d8942c4b2 req-58f5edfb-8a7d-42ce-9cf4-77e538c31be0 service nova] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-996f1e8d-33d2-4c62-9f07-c45d8942c4b2 req-58f5edfb-8a7d-42ce-9cf4-77e538c31be0 service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] No waiting events found dispatching network-vif-unplugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG nova.compute.manager [req-996f1e8d-33d2-4c62-9f07-c45d8942c4b2 req-58f5edfb-8a7d-42ce-9cf4-77e538c31be0 service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received event network-vif-unplugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:27:29 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Instance destroyed successfully.
Jul 25 17:27:29 user nova-compute[70659]: DEBUG nova.objects.instance [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'resources' on Instance uuid 8aa7f902-5046-4728-9c40-b3e29f5b5c2b {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:25:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1263880360',display_name='tempest-TestVolumeBootPattern-server-1263880360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1263880360',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7QC9uQNcrFBBHhXb6+i8aDbLy+AmkigPFGq2n70Q94ElSP++KO63c8If7gMAeO1JcU0nisu+1PGDE2+JJPvX/ZM3iLaeFqNAR6ful0rfkF02TtegfxcAlURif+gavTIA==',key_name='tempest-TestVolumeBootPattern-228752096',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:25:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-mn09cfru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:25:47Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=8aa7f902-5046-4728-9c40-b3e29f5b5c2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "address": "fa:16:3e:21:d8:fe", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1998b4f-be", "ovs_interfaceid": "e1998b4f-bea6-44b4-93cb-c683fff1fb2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:d8:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1998b4f-bea6-44b4-93cb-c683fff1fb2e,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1998b4f-be') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_vif [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d8:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1998b4f-bea6-44b4-93cb-c683fff1fb2e,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1998b4f-be') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1998b4f-be, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:27:29 user nova-compute[70659]: INFO os_vif [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d8:fe,bridge_name='br-int',has_traffic_filtering=True,id=e1998b4f-bea6-44b4-93cb-c683fff1fb2e,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1998b4f-be')
Jul 25 17:27:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsFpuSkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:27:29 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e158e8-2391-4590-953a-acd3677f4a62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc61b45-921b-4467-984d-dbf052e09ab3]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:27:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:27:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd303a20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d3184c-d62b-4829-88ec-a2a3210a06e1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1936a404-6afd-4557-af52-f131e3e24145]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d07ecb6-3ccc-47e3-b039-aa1502005a12]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99f4f43-13d8-403c-a9b0-02e7843ca7c7]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fd2708ad', '/dev/disk/by-id/scsi-1SCST_BIOfd2708ad-c5fae95493212754', '/dev/disk/by-id/scsi-26335666165393534') {{(pid=81811) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[83359c3f-deeb-4fe1-a995-7942c5655b77]: (4, None) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3539336a-a77c-4ea1-9ce0-9c8945ca3ce3]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afcf459-6bbf-4815-a5ae-b63a591675e3]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260]
Jul 25 17:27:29 user nova-compute[70659]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260] successful.
Jul 25 17:27:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d82a31-b575-4174-8fb3-234ea9f53ae5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== disconnect_volume: return (279ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:27:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:27:29 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Deleting instance files /opt/stack/data/nova/instances/8aa7f902-5046-4728-9c40-b3e29f5b5c2b_del
Jul 25 17:27:29 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Deletion of /opt/stack/data/nova/instances/8aa7f902-5046-4728-9c40-b3e29f5b5c2b_del complete
Jul 25 17:27:30 user nova-compute[70659]: INFO nova.compute.manager [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 25 17:27:30 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:27:30 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:27:30 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:27:30 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:27:30 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Took 0.89 seconds to deallocate network for instance.
Jul 25 17:27:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-8def192f-94ab-427e-a40b-fcc645f1f23a req-142348d8-ba72-4abb-b1ec-1a0f5d49e21e service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received event network-vif-plugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:27:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8def192f-94ab-427e-a40b-fcc645f1f23a req-142348d8-ba72-4abb-b1ec-1a0f5d49e21e service nova] Acquiring lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:27:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8def192f-94ab-427e-a40b-fcc645f1f23a req-142348d8-ba72-4abb-b1ec-1a0f5d49e21e service nova] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:27:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-8def192f-94ab-427e-a40b-fcc645f1f23a req-142348d8-ba72-4abb-b1ec-1a0f5d49e21e service nova] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:27:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-8def192f-94ab-427e-a40b-fcc645f1f23a req-142348d8-ba72-4abb-b1ec-1a0f5d49e21e service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] No waiting events found dispatching network-vif-plugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:27:31 user nova-compute[70659]: WARNING nova.compute.manager [req-8def192f-94ab-427e-a40b-fcc645f1f23a req-142348d8-ba72-4abb-b1ec-1a0f5d49e21e service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received unexpected event network-vif-plugged-e1998b4f-bea6-44b4-93cb-c683fff1fb2e for instance with vm_state active and task_state deleting.
Jul 25 17:27:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-8def192f-94ab-427e-a40b-fcc645f1f23a req-142348d8-ba72-4abb-b1ec-1a0f5d49e21e service nova] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Received event network-vif-deleted-e1998b4f-bea6-44b4-93cb-c683fff1fb2e {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:27:31 user nova-compute[70659]: INFO nova.compute.manager [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Took 0.74 seconds to detach 1 volumes for instance.
Jul 25 17:27:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:27:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:27:31 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:27:31 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:27:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:27:31 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Deleted allocations for instance 8aa7f902-5046-4728-9c40-b3e29f5b5c2b
Jul 25 17:27:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-83308ac2-7e78-4f5f-ae47-c4bc49a00dfc tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "8aa7f902-5046-4728-9c40-b3e29f5b5c2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.105s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:27:32 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:27:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:27:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 17:27:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:44 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690306049.5797026, 8aa7f902-5046-4728-9c40-b3e29f5b5c2b => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:27:44 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] VM Stopped (Lifecycle Event)
Jul 25 17:27:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-35de75a4-a3e4-489d-80e2-c545e9579674 None None] [instance: 8aa7f902-5046-4728-9c40-b3e29f5b5c2b] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:27:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 17:27:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:27:51 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:27:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:27:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:28:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:28:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:28:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:28:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:28:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:28:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:28:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:28:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:28:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:12 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:16 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:28:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:28:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:28:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:28:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:28:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "c4941239-6429-44c5-a691-a68aa6304593" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:28:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "c4941239-6429-44c5-a691-a68aa6304593" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:28:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:28:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:28:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:28:20 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:28:20 user nova-compute[70659]: INFO nova.compute.claims [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Claim successful on node user
Jul 25 17:28:20 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 17:28:20 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 17:28:20 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:28:21 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:28:21 user nova-compute[70659]: INFO nova.virt.block_device [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Booting with volume f4666ea5-b543-4205-8461-d5fa4edb1e09 at /dev/vda
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.policy [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80d4bea31bd94de88d07d0b7bae77086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ec6ce16624cd8af59a77456e647b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG os_brick.utils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[13af92ff-eaf8-4ef5-8217-f931302fe54f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7beeb70-2748-4812-89c3-46eec90f08a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c660a8a-80a2-4356-9b51-4d1f33597b9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[762cb4a1-bef2-4f6c-894d-7e11398e9283]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:28:21 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:28:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f9b817-fb0b-4270-8ecc-f01027b393f7]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG os_brick.utils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:28:21 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating existing volume attachment record: 9ecf4ce8-6f93-435c-ae5d-54ef1b710673 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG nova.network.neutron [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Successfully created port: 18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:28:22 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:28:22 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:28:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=25.163516998291016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c4941239-6429-44c5-a691-a68aa6304593 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:28:22 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:28:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Successfully updated port: 18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:28:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:28:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquired lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:28:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:28:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-69796ddf-69ae-446c-b9d6-a15dc143dd24 req-78a89153-7885-4d6c-82d2-b8b37602753f service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received event network-changed-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:28:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-69796ddf-69ae-446c-b9d6-a15dc143dd24 req-78a89153-7885-4d6c-82d2-b8b37602753f service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Refreshing instance network info cache due to event network-changed-18b1fc93-6046-48df-88f8-e7fed03e0834. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:28:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-69796ddf-69ae-446c-b9d6-a15dc143dd24 req-78a89153-7885-4d6c-82d2-b8b37602753f service nova] Acquiring lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:28:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:28:24 user nova-compute[70659]: DEBUG nova.network.neutron [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:28:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Releasing lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:28:24 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Instance network_info: |[{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:28:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-69796ddf-69ae-446c-b9d6-a15dc143dd24 req-78a89153-7885-4d6c-82d2-b8b37602753f service nova] Acquired lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:28:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-69796ddf-69ae-446c-b9d6-a15dc143dd24 req-78a89153-7885-4d6c-82d2-b8b37602753f service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Refreshing network info cache for port 18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:28:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-69796ddf-69ae-446c-b9d6-a15dc143dd24 req-78a89153-7885-4d6c-82d2-b8b37602753f service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updated VIF entry in instance network info cache for port 18b1fc93-6046-48df-88f8-e7fed03e0834. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:28:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-69796ddf-69ae-446c-b9d6-a15dc143dd24 req-78a89153-7885-4d6c-82d2-b8b37602753f service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:28:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-69796ddf-69ae-446c-b9d6-a15dc143dd24 req-78a89153-7885-4d6c-82d2-b8b37602753f service nova] Releasing lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:28:26 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:28:28 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Creating image(s)
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Ensure instance console log exists: /opt/stack/data/nova/instances/c4941239-6429-44c5-a691-a68aa6304593/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Start _get_guest_xml network_info=[{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9ecf4ce8-6f93-435c-ae5d-54ef1b710673', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsFpuSkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4941239-6429-44c5-a691-a68aa6304593', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4666ea5-b543-4205-8461-d5fa4edb1e09', 'serial': 'f4666ea5-b543-4205-8461-d5fa4edb1e09'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:28:28 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:28:28 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsFpuSkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:28:28 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:28:28 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:28:28 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c39122-24e4-4d4e-a278-19c249ef23b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:28:28 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c21a0df-17a7-4939-95bc-3b60642ab29c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09] added
Jul 25 17:28:28 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbfe9e1-422f-4592-b993-8c938f919f17]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8b69ce-751b-414f-8b18-643026f2918d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsFpuSkm {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsFpuSkm" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f9955b-e3bf-4fa1-8430-a2b76d966bd1]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BsFpuSkm'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f0dc0-c6af-4bac-bc43-74679ed51db8]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bfb8ac-f8cf-45c7-8f16-0b818dc0377d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:28:28 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:28:28 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:28:28 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 17:28:28 user nova-compute[70659]: 
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ca8501-11a5-42cc-be9e-08157b8d9067]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260]
Jul 25 17:28:28 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260] successful.
Jul 25 17:28:28 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d796e63-2714-4db6-911c-029645eb3d10]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9da9db2-7628-4c50-927d-28fa9d73a7fd]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:28:28 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:28:28 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de59bb3-9864-4af9-b2ad-551cbf7d99b2]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:28:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsFpuSkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26335666165393534', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335666165393534', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1763945206',display_name='tempest-TestVolumeBootPattern-server-1763945206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1763945206',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7QC9uQNcrFBBHhXb6+i8aDbLy+AmkigPFGq2n70Q94ElSP++KO63c8If7gMAeO1JcU0nisu+1PGDE2+JJPvX/ZM3iLaeFqNAR6ful0rfkF02TtegfxcAlURif+gavTIA==',key_name='tempest-TestVolumeBootPattern-228752096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-7vsfyor4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:28:21Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=c4941239-6429-44c5-a691-a68aa6304593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:8b,bridge_name='br-int',has_traffic_filtering=True,id=18b1fc93-6046-48df-88f8-e7fed03e0834,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b1fc93-60') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.objects.instance [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'pci_devices' on Instance uuid c4941239-6429-44c5-a691-a68aa6304593 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:28:29 user nova-compute[70659]:   <uuid>c4941239-6429-44c5-a691-a68aa6304593</uuid>
Jul 25 17:28:29 user nova-compute[70659]:   <name>instance-00000032</name>
Jul 25 17:28:29 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:28:29 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:28:29 user nova-compute[70659]:   <metadata>
Jul 25 17:28:29 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:28:29 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:28:29 user nova-compute[70659]:       <nova:name>tempest-TestVolumeBootPattern-server-1763945206</nova:name>
Jul 25 17:28:29 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:28:28</nova:creationTime>
Jul 25 17:28:29 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:28:29 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:28:29 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:28:29 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:28:29 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:28:29 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:28:29 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:28:29 user nova-compute[70659]:       <nova:owner>
Jul 25 17:28:29 user nova-compute[70659]:         <nova:user uuid="80d4bea31bd94de88d07d0b7bae77086">tempest-TestVolumeBootPattern-1024566986-project-member</nova:user>
Jul 25 17:28:29 user nova-compute[70659]:         <nova:project uuid="f60ec6ce16624cd8af59a77456e647b9">tempest-TestVolumeBootPattern-1024566986</nova:project>
Jul 25 17:28:29 user nova-compute[70659]:       </nova:owner>
Jul 25 17:28:29 user nova-compute[70659]:       <nova:ports>
Jul 25 17:28:29 user nova-compute[70659]:         <nova:port uuid="18b1fc93-6046-48df-88f8-e7fed03e0834">
Jul 25 17:28:29 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 17:28:29 user nova-compute[70659]:         </nova:port>
Jul 25 17:28:29 user nova-compute[70659]:       </nova:ports>
Jul 25 17:28:29 user nova-compute[70659]:     </nova:instance>
Jul 25 17:28:29 user nova-compute[70659]:   </metadata>
Jul 25 17:28:29 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:28:29 user nova-compute[70659]:     <system>
Jul 25 17:28:29 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:28:29 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:28:29 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:28:29 user nova-compute[70659]:       <entry name="serial">c4941239-6429-44c5-a691-a68aa6304593</entry>
Jul 25 17:28:29 user nova-compute[70659]:       <entry name="uuid">c4941239-6429-44c5-a691-a68aa6304593</entry>
Jul 25 17:28:29 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:28:29 user nova-compute[70659]:     </system>
Jul 25 17:28:29 user nova-compute[70659]:   </sysinfo>
Jul 25 17:28:29 user nova-compute[70659]:   <os>
Jul 25 17:28:29 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:28:29 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:28:29 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:28:29 user nova-compute[70659]:   </os>
Jul 25 17:28:29 user nova-compute[70659]:   <features>
Jul 25 17:28:29 user nova-compute[70659]:     <acpi/>
Jul 25 17:28:29 user nova-compute[70659]:     <apic/>
Jul 25 17:28:29 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:28:29 user nova-compute[70659]:   </features>
Jul 25 17:28:29 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:28:29 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:28:29 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:28:29 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:28:29 user nova-compute[70659]:   </clock>
Jul 25 17:28:29 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:28:29 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:28:29 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:28:29 user nova-compute[70659]:   </cpu>
Jul 25 17:28:29 user nova-compute[70659]:   <devices>
Jul 25 17:28:29 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:28:29 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:28:29 user nova-compute[70659]:       <source dev="/dev/sdb"/>
Jul 25 17:28:29 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:28:29 user nova-compute[70659]:       <serial>f4666ea5-b543-4205-8461-d5fa4edb1e09</serial>
Jul 25 17:28:29 user nova-compute[70659]:     </disk>
Jul 25 17:28:29 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:28:29 user nova-compute[70659]:       <mac address="fa:16:3e:40:0c:8b"/>
Jul 25 17:28:29 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:28:29 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:28:29 user nova-compute[70659]:       <target dev="tap18b1fc93-60"/>
Jul 25 17:28:29 user nova-compute[70659]:     </interface>
Jul 25 17:28:29 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:28:29 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/c4941239-6429-44c5-a691-a68aa6304593/console.log" append="off"/>
Jul 25 17:28:29 user nova-compute[70659]:     </serial>
Jul 25 17:28:29 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:28:29 user nova-compute[70659]:     <video>
Jul 25 17:28:29 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:28:29 user nova-compute[70659]:     </video>
Jul 25 17:28:29 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:28:29 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:28:29 user nova-compute[70659]:     </rng>
Jul 25 17:28:29 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:28:29 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:28:29 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:28:29 user nova-compute[70659]:     </memballoon>
Jul 25 17:28:29 user nova-compute[70659]:   </devices>
Jul 25 17:28:29 user nova-compute[70659]: </domain>
Jul 25 17:28:29 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1763945206',display_name='tempest-TestVolumeBootPattern-server-1763945206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1763945206',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7QC9uQNcrFBBHhXb6+i8aDbLy+AmkigPFGq2n70Q94ElSP++KO63c8If7gMAeO1JcU0nisu+1PGDE2+JJPvX/ZM3iLaeFqNAR6ful0rfkF02TtegfxcAlURif+gavTIA==',key_name='tempest-TestVolumeBootPattern-228752096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-7vsfyor4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:28:21Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=c4941239-6429-44c5-a691-a68aa6304593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:8b,bridge_name='br-int',has_traffic_filtering=True,id=18b1fc93-6046-48df-88f8-e7fed03e0834,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b1fc93-60') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG os_vif [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:8b,bridge_name='br-int',has_traffic_filtering=True,id=18b1fc93-6046-48df-88f8-e7fed03e0834,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b1fc93-60') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18b1fc93-60, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18b1fc93-60, col_values=(('external_ids', {'iface-id': '18b1fc93-6046-48df-88f8-e7fed03e0834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:0c:8b', 'vm-uuid': 'c4941239-6429-44c5-a691-a68aa6304593'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:29 user nova-compute[70659]: INFO os_vif [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:0c:8b,bridge_name='br-int',has_traffic_filtering=True,id=18b1fc93-6046-48df-88f8-e7fed03e0834,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b1fc93-60')
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:28:29 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No VIF found with MAC fa:16:3e:40:0c:8b, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:28:30 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-af9ef023-c56c-4264-bc59-3c79abd925a8 req-503b75b8-e68b-461a-a285-8bcf0fb12aa5 service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received event network-vif-plugged-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:28:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-af9ef023-c56c-4264-bc59-3c79abd925a8 req-503b75b8-e68b-461a-a285-8bcf0fb12aa5 service nova] Acquiring lock "c4941239-6429-44c5-a691-a68aa6304593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:28:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-af9ef023-c56c-4264-bc59-3c79abd925a8 req-503b75b8-e68b-461a-a285-8bcf0fb12aa5 service nova] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:28:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-af9ef023-c56c-4264-bc59-3c79abd925a8 req-503b75b8-e68b-461a-a285-8bcf0fb12aa5 service nova] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:28:30 user nova-compute[70659]: DEBUG nova.compute.manager [req-af9ef023-c56c-4264-bc59-3c79abd925a8 req-503b75b8-e68b-461a-a285-8bcf0fb12aa5 service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] No waiting events found dispatching network-vif-plugged-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:28:30 user nova-compute[70659]: WARNING nova.compute.manager [req-af9ef023-c56c-4264-bc59-3c79abd925a8 req-503b75b8-e68b-461a-a285-8bcf0fb12aa5 service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received unexpected event network-vif-plugged-18b1fc93-6046-48df-88f8-e7fed03e0834 for instance with vm_state building and task_state spawning.
Jul 25 17:28:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690306112.751842, c4941239-6429-44c5-a691-a68aa6304593 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:28:32 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] VM Resumed (Lifecycle Event)
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:28:32 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: c4941239-6429-44c5-a691-a68aa6304593] Instance spawned successfully.
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:32 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690306112.754849, c4941239-6429-44c5-a691-a68aa6304593 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:28:32 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] VM Started (Lifecycle Event)
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:28:32 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:28:32 user nova-compute[70659]: INFO nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Took 4.85 seconds to spawn the instance on the hypervisor.
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:28:32 user nova-compute[70659]: INFO nova.compute.manager [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Took 12.22 seconds to build instance.
Jul 25 17:28:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-c85ffa08-c076-47ea-99b0-af1877e9c11a tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "c4941239-6429-44c5-a691-a68aa6304593" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.313s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-02e3625c-5e39-4432-9921-525c56f6696f req-f9582130-8c4a-4c5a-ab8d-935bf5774bff service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received event network-vif-plugged-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02e3625c-5e39-4432-9921-525c56f6696f req-f9582130-8c4a-4c5a-ab8d-935bf5774bff service nova] Acquiring lock "c4941239-6429-44c5-a691-a68aa6304593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02e3625c-5e39-4432-9921-525c56f6696f req-f9582130-8c4a-4c5a-ab8d-935bf5774bff service nova] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-02e3625c-5e39-4432-9921-525c56f6696f req-f9582130-8c4a-4c5a-ab8d-935bf5774bff service nova] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:28:32 user nova-compute[70659]: DEBUG nova.compute.manager [req-02e3625c-5e39-4432-9921-525c56f6696f req-f9582130-8c4a-4c5a-ab8d-935bf5774bff service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] No waiting events found dispatching network-vif-plugged-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:28:32 user nova-compute[70659]: WARNING nova.compute.manager [req-02e3625c-5e39-4432-9921-525c56f6696f req-f9582130-8c4a-4c5a-ab8d-935bf5774bff service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received unexpected event network-vif-plugged-18b1fc93-6046-48df-88f8-e7fed03e0834 for instance with vm_state active and task_state None.
Jul 25 17:28:34 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid c4941239-6429-44c5-a691-a68aa6304593 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:28:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:28:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:28:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:28:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:28:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:28:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:28:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:14 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:29:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:29:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:29:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:29:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:29:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:29:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:29:23 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:29:23 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:29:23 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8819MB free_disk=25.1619873046875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c4941239-6429-44c5-a691-a68aa6304593 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:29:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:29:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:29:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:29:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:29:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:29:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:26 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:29:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:29:31 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:29:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:29:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:29:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:29:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:29:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid c4941239-6429-44c5-a691-a68aa6304593 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:29:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:29:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:29:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:29:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:29:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:29:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:29:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:29:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:29:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:30:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:30:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:30:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:30:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-1cf631d7-19e9-4d77-bed8-712c56a170ef req-7158ab41-0322-4e09-bfb7-715b5bcafa8c service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received event network-changed-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:30:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-1cf631d7-19e9-4d77-bed8-712c56a170ef req-7158ab41-0322-4e09-bfb7-715b5bcafa8c service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Refreshing instance network info cache due to event network-changed-18b1fc93-6046-48df-88f8-e7fed03e0834. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:30:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1cf631d7-19e9-4d77-bed8-712c56a170ef req-7158ab41-0322-4e09-bfb7-715b5bcafa8c service nova] Acquiring lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:30:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1cf631d7-19e9-4d77-bed8-712c56a170ef req-7158ab41-0322-4e09-bfb7-715b5bcafa8c service nova] Acquired lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:30:12 user nova-compute[70659]: DEBUG nova.network.neutron [req-1cf631d7-19e9-4d77-bed8-712c56a170ef req-7158ab41-0322-4e09-bfb7-715b5bcafa8c service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Refreshing network info cache for port 18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:30:13 user nova-compute[70659]: DEBUG nova.network.neutron [req-1cf631d7-19e9-4d77-bed8-712c56a170ef req-7158ab41-0322-4e09-bfb7-715b5bcafa8c service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updated VIF entry in instance network info cache for port 18b1fc93-6046-48df-88f8-e7fed03e0834. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:30:13 user nova-compute[70659]: DEBUG nova.network.neutron [req-1cf631d7-19e9-4d77-bed8-712c56a170ef req-7158ab41-0322-4e09-bfb7-715b5bcafa8c service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:30:13 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-1cf631d7-19e9-4d77-bed8-712c56a170ef req-7158ab41-0322-4e09-bfb7-715b5bcafa8c service nova] Releasing lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:30:14 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:18 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "10bf2753-7a4c-437e-b58f-29872659ae42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "10bf2753-7a4c-437e-b58f-29872659ae42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:30:21 user nova-compute[70659]: INFO nova.compute.claims [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Claim successful on node user
Jul 25 17:30:21 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:30:21 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:30:21 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:30:21 user nova-compute[70659]: INFO nova.virt.block_device [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Booting with volume 38447f06-f818-43de-aae4-97dbc76dbcc2 at /dev/vda
Jul 25 17:30:21 user nova-compute[70659]: DEBUG nova.policy [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80d4bea31bd94de88d07d0b7bae77086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60ec6ce16624cd8af59a77456e647b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG os_brick.utils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[593fc32c-f52d-46e9-93ef-a585bf3b63c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f2ee7-6f74-4f4d-bc3a-ddbdfac9ce32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:21 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e1cfe-1fb0-46f3-990a-8f33505fe658]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c41b18-d478-4972-8958-98b11f0d4e54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:30:22 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:30:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf21dce-ea43-4bda-a894-aa6ab1b47827]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG os_brick.utils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updating existing volume attachment record: cb7dec01-a591-4cec-a383-a39576f74c00 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Successfully created port: c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:30:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Successfully updated port: c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquired lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-afd1b741-4731-4392-81ae-b79d99c6b327 req-f9e1f644-8736-4ae7-83b2-f39862f6c64d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received event network-changed-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG nova.compute.manager [req-afd1b741-4731-4392-81ae-b79d99c6b327 req-f9e1f644-8736-4ae7-83b2-f39862f6c64d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Refreshing instance network info cache due to event network-changed-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-afd1b741-4731-4392-81ae-b79d99c6b327 req-f9e1f644-8736-4ae7-83b2-f39862f6c64d service nova] Acquiring lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG nova.network.neutron [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updating instance_info_cache with network_info: [{"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Releasing lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Instance network_info: |[{"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-afd1b741-4731-4392-81ae-b79d99c6b327 req-f9e1f644-8736-4ae7-83b2-f39862f6c64d service nova] Acquired lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:30:23 user nova-compute[70659]: DEBUG nova.network.neutron [req-afd1b741-4731-4392-81ae-b79d99c6b327 req-f9e1f644-8736-4ae7-83b2-f39862f6c64d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Refreshing network info cache for port c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:30:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-afd1b741-4731-4392-81ae-b79d99c6b327 req-f9e1f644-8736-4ae7-83b2-f39862f6c64d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updated VIF entry in instance network info cache for port c058f34b-5e9c-4f7b-888f-9d66a5cfaf85. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:30:24 user nova-compute[70659]: DEBUG nova.network.neutron [req-afd1b741-4731-4392-81ae-b79d99c6b327 req-f9e1f644-8736-4ae7-83b2-f39862f6c64d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updating instance_info_cache with network_info: [{"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:30:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-afd1b741-4731-4392-81ae-b79d99c6b327 req-f9e1f644-8736-4ae7-83b2-f39862f6c64d service nova] Releasing lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:30:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:30:25 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:30:25 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=25.160839080810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c4941239-6429-44c5-a691-a68aa6304593 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 10bf2753-7a4c-437e-b58f-29872659ae42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:30:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:30:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:30:28 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Creating image(s)
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Did not create local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Ensure instance console log exists: /opt/stack/data/nova/instances/10bf2753-7a4c-437e-b58f-29872659ae42/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Start _get_guest_xml network_info=[{"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cb7dec01-a591-4cec-a383-a39576f74c00', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDAymoQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10bf2753-7a4c-437e-b58f-29872659ae42', 'attached_at': '', 'detached_at': '', 'volume_id': '38447f06-f818-43de-aae4-97dbc76dbcc2', 'serial': '38447f06-f818-43de-aae4-97dbc76dbcc2'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:30:28 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:30:28 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDAymoQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:30:28 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:30:28 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:30:28 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eefc923-0a9b-44f7-b4ca-795694638049]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:30:28 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[675b08d6-2e4a-4a7f-a075-3023c06eeaef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2] added
Jul 25 17:30:28 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7df5a70-c5b8-4c0a-a650-ea53f62a6f3d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6583462-ebf9-4e92-9ea2-b16e0a922a42]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDAymoQn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDAymoQn" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17d91a3-ed6e-4b7f-a9e7-763ced814f50]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDAymoQn'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd13be7-a11b-4d33-967b-f5b99a95ac8d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e732b509-ebaf-4ac4-b6fd-10ed8b2bd662]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:30:28 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:30:28 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1373faee-1676-48d8-b3c8-ffae66a7c7b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2, portal: 172.16.0.220,3260]
Jul 25 17:30:28 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2, portal: 172.16.0.220,3260] successful.
Jul 25 17:30:28 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:28 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[859085e3-3b9c-43e0-b755-623fd0b03e0d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bf63f5-33fa-4a21-b3ad-cfc84ef3989d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:30:29 user nova-compute[70659]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 (non-flash)
Jul 25 17:30:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:30:29 user nova-compute[70659]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 (non-flash)
Jul 25 17:30:29 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e789728-9f9e-476c-945f-d9c746214c60]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDAymoQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:30:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23637383166646165', 'path': '/dev/sdc'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383166646165', 'path': '/dev/sdc'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-570294884',display_name='tempest-TestVolumeBootPattern-server-570294884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-570294884',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7QC9uQNcrFBBHhXb6+i8aDbLy+AmkigPFGq2n70Q94ElSP++KO63c8If7gMAeO1JcU0nisu+1PGDE2+JJPvX/ZM3iLaeFqNAR6ful0rfkF02TtegfxcAlURif+gavTIA==',key_name='tempest-TestVolumeBootPattern-228752096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-bykytuk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:30:22Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=10bf2753-7a4c-437e-b58f-29872659ae42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:eb:8f,bridge_name='br-int',has_traffic_filtering=True,id=c058f34b-5e9c-4f7b-888f-9d66a5cfaf85,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc058f34b-5e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'pci_devices' on Instance uuid 10bf2753-7a4c-437e-b58f-29872659ae42 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:30:30 user nova-compute[70659]:   <uuid>10bf2753-7a4c-437e-b58f-29872659ae42</uuid>
Jul 25 17:30:30 user nova-compute[70659]:   <name>instance-00000033</name>
Jul 25 17:30:30 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:30:30 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:30:30 user nova-compute[70659]:   <metadata>
Jul 25 17:30:30 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:30:30 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:30:30 user nova-compute[70659]:       <nova:name>tempest-TestVolumeBootPattern-server-570294884</nova:name>
Jul 25 17:30:30 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:30:28</nova:creationTime>
Jul 25 17:30:30 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:30:30 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:30:30 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:30:30 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:30:30 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:30:30 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:30:30 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:30:30 user nova-compute[70659]:       <nova:owner>
Jul 25 17:30:30 user nova-compute[70659]:         <nova:user uuid="80d4bea31bd94de88d07d0b7bae77086">tempest-TestVolumeBootPattern-1024566986-project-member</nova:user>
Jul 25 17:30:30 user nova-compute[70659]:         <nova:project uuid="f60ec6ce16624cd8af59a77456e647b9">tempest-TestVolumeBootPattern-1024566986</nova:project>
Jul 25 17:30:30 user nova-compute[70659]:       </nova:owner>
Jul 25 17:30:30 user nova-compute[70659]:       <nova:ports>
Jul 25 17:30:30 user nova-compute[70659]:         <nova:port uuid="c058f34b-5e9c-4f7b-888f-9d66a5cfaf85">
Jul 25 17:30:30 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 17:30:30 user nova-compute[70659]:         </nova:port>
Jul 25 17:30:30 user nova-compute[70659]:       </nova:ports>
Jul 25 17:30:30 user nova-compute[70659]:     </nova:instance>
Jul 25 17:30:30 user nova-compute[70659]:   </metadata>
Jul 25 17:30:30 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:30:30 user nova-compute[70659]:     <system>
Jul 25 17:30:30 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:30:30 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:30:30 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:30:30 user nova-compute[70659]:       <entry name="serial">10bf2753-7a4c-437e-b58f-29872659ae42</entry>
Jul 25 17:30:30 user nova-compute[70659]:       <entry name="uuid">10bf2753-7a4c-437e-b58f-29872659ae42</entry>
Jul 25 17:30:30 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:30:30 user nova-compute[70659]:     </system>
Jul 25 17:30:30 user nova-compute[70659]:   </sysinfo>
Jul 25 17:30:30 user nova-compute[70659]:   <os>
Jul 25 17:30:30 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:30:30 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:30:30 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:30:30 user nova-compute[70659]:   </os>
Jul 25 17:30:30 user nova-compute[70659]:   <features>
Jul 25 17:30:30 user nova-compute[70659]:     <acpi/>
Jul 25 17:30:30 user nova-compute[70659]:     <apic/>
Jul 25 17:30:30 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:30:30 user nova-compute[70659]:   </features>
Jul 25 17:30:30 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:30:30 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:30:30 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:30:30 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:30:30 user nova-compute[70659]:   </clock>
Jul 25 17:30:30 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:30:30 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:30:30 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:30:30 user nova-compute[70659]:   </cpu>
Jul 25 17:30:30 user nova-compute[70659]:   <devices>
Jul 25 17:30:30 user nova-compute[70659]:     <disk type="block" device="disk">
Jul 25 17:30:30 user nova-compute[70659]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:30:30 user nova-compute[70659]:       <source dev="/dev/sdc"/>
Jul 25 17:30:30 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:30:30 user nova-compute[70659]:       <serial>38447f06-f818-43de-aae4-97dbc76dbcc2</serial>
Jul 25 17:30:30 user nova-compute[70659]:     </disk>
Jul 25 17:30:30 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:30:30 user nova-compute[70659]:       <mac address="fa:16:3e:d3:eb:8f"/>
Jul 25 17:30:30 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:30:30 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:30:30 user nova-compute[70659]:       <target dev="tapc058f34b-5e"/>
Jul 25 17:30:30 user nova-compute[70659]:     </interface>
Jul 25 17:30:30 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:30:30 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/10bf2753-7a4c-437e-b58f-29872659ae42/console.log" append="off"/>
Jul 25 17:30:30 user nova-compute[70659]:     </serial>
Jul 25 17:30:30 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:30:30 user nova-compute[70659]:     <video>
Jul 25 17:30:30 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:30:30 user nova-compute[70659]:     </video>
Jul 25 17:30:30 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:30:30 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:30:30 user nova-compute[70659]:     </rng>
Jul 25 17:30:30 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:30:30 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:30:30 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:30:30 user nova-compute[70659]:     </memballoon>
Jul 25 17:30:30 user nova-compute[70659]:   </devices>
Jul 25 17:30:30 user nova-compute[70659]: </domain>
Jul 25 17:30:30 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-570294884',display_name='tempest-TestVolumeBootPattern-server-570294884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-570294884',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7QC9uQNcrFBBHhXb6+i8aDbLy+AmkigPFGq2n70Q94ElSP++KO63c8If7gMAeO1JcU0nisu+1PGDE2+JJPvX/ZM3iLaeFqNAR6ful0rfkF02TtegfxcAlURif+gavTIA==',key_name='tempest-TestVolumeBootPattern-228752096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-bykytuk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:30:22Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=10bf2753-7a4c-437e-b58f-29872659ae42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:eb:8f,bridge_name='br-int',has_traffic_filtering=True,id=c058f34b-5e9c-4f7b-888f-9d66a5cfaf85,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc058f34b-5e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG os_vif [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:eb:8f,bridge_name='br-int',has_traffic_filtering=True,id=c058f34b-5e9c-4f7b-888f-9d66a5cfaf85,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc058f34b-5e') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc058f34b-5e, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc058f34b-5e, col_values=(('external_ids', {'iface-id': 'c058f34b-5e9c-4f7b-888f-9d66a5cfaf85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:eb:8f', 'vm-uuid': '10bf2753-7a4c-437e-b58f-29872659ae42'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:30 user nova-compute[70659]: INFO os_vif [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:eb:8f,bridge_name='br-int',has_traffic_filtering=True,id=c058f34b-5e9c-4f7b-888f-9d66a5cfaf85,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc058f34b-5e')
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:30:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] No VIF found with MAC fa:16:3e:d3:eb:8f, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:30:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-425ed657-a498-4679-9971-db7e9804dd11 req-33178287-005f-4a1d-940e-00408d54bbe6 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received event network-vif-plugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:30:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-425ed657-a498-4679-9971-db7e9804dd11 req-33178287-005f-4a1d-940e-00408d54bbe6 service nova] Acquiring lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:30:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-425ed657-a498-4679-9971-db7e9804dd11 req-33178287-005f-4a1d-940e-00408d54bbe6 service nova] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:30:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-425ed657-a498-4679-9971-db7e9804dd11 req-33178287-005f-4a1d-940e-00408d54bbe6 service nova] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:30:31 user nova-compute[70659]: DEBUG nova.compute.manager [req-425ed657-a498-4679-9971-db7e9804dd11 req-33178287-005f-4a1d-940e-00408d54bbe6 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] No waiting events found dispatching network-vif-plugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:30:31 user nova-compute[70659]: WARNING nova.compute.manager [req-425ed657-a498-4679-9971-db7e9804dd11 req-33178287-005f-4a1d-940e-00408d54bbe6 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received unexpected event network-vif-plugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 for instance with vm_state building and task_state spawning.
Jul 25 17:30:31 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690306233.4912694, 10bf2753-7a4c-437e-b58f-29872659ae42 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:30:33 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] VM Resumed (Lifecycle Event)
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:30:33 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Instance spawned successfully.
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:30:33 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690306233.4922547, 10bf2753-7a4c-437e-b58f-29872659ae42 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:30:33 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] VM Started (Lifecycle Event)
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:30:33 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:30:33 user nova-compute[70659]: INFO nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Took 4.90 seconds to spawn the instance on the hypervisor.
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.compute.manager [req-699d0a58-3a80-4711-b55f-c02b04b6fb74 req-f6f5a7d3-6f6b-42a2-b934-b431f38a3fbd service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received event network-vif-plugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-699d0a58-3a80-4711-b55f-c02b04b6fb74 req-f6f5a7d3-6f6b-42a2-b934-b431f38a3fbd service nova] Acquiring lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-699d0a58-3a80-4711-b55f-c02b04b6fb74 req-f6f5a7d3-6f6b-42a2-b934-b431f38a3fbd service nova] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-699d0a58-3a80-4711-b55f-c02b04b6fb74 req-f6f5a7d3-6f6b-42a2-b934-b431f38a3fbd service nova] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:30:33 user nova-compute[70659]: DEBUG nova.compute.manager [req-699d0a58-3a80-4711-b55f-c02b04b6fb74 req-f6f5a7d3-6f6b-42a2-b934-b431f38a3fbd service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] No waiting events found dispatching network-vif-plugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:30:33 user nova-compute[70659]: WARNING nova.compute.manager [req-699d0a58-3a80-4711-b55f-c02b04b6fb74 req-f6f5a7d3-6f6b-42a2-b934-b431f38a3fbd service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received unexpected event network-vif-plugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 for instance with vm_state building and task_state spawning.
Jul 25 17:30:33 user nova-compute[70659]: INFO nova.compute.manager [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Took 12.17 seconds to build instance.
Jul 25 17:30:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b452b4ce-9d41-4953-a95f-22c68be2c040 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "10bf2753-7a4c-437e-b58f-29872659ae42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.435s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:30:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid c4941239-6429-44c5-a691-a68aa6304593 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:30:37 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:30:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:30:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:30:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:30:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:30:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:30:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:30:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:30:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:30:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:30:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:30:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:31:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:31:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:31:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:31:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:31:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:23 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:31:24 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:31:25 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:31:25 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.15947723388672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c4941239-6429-44c5-a691-a68aa6304593 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance 10bf2753-7a4c-437e-b58f-29872659ae42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:31:25 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:31:28 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:31:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:31:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:33 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:31:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:31:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:31:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:31:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:31:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:31:39 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updating instance_info_cache with network_info: [{"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:31:39 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:31:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:31:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:31:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:31:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:31:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:31:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:31:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:31:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:32:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:32:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:32:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:32:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:32:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:32:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:32:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:32:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:32:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:32:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:13 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 17:32:13 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-a4d61dfb-9560-4909-92d7-24a06f1cda31 req-4531d717-9832-4e2f-bfc0-107138f2a73d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received event network-changed-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-a4d61dfb-9560-4909-92d7-24a06f1cda31 req-4531d717-9832-4e2f-bfc0-107138f2a73d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Refreshing instance network info cache due to event network-changed-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a4d61dfb-9560-4909-92d7-24a06f1cda31 req-4531d717-9832-4e2f-bfc0-107138f2a73d service nova] Acquiring lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a4d61dfb-9560-4909-92d7-24a06f1cda31 req-4531d717-9832-4e2f-bfc0-107138f2a73d service nova] Acquired lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG nova.network.neutron [req-a4d61dfb-9560-4909-92d7-24a06f1cda31 req-4531d717-9832-4e2f-bfc0-107138f2a73d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Refreshing network info cache for port c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG nova.network.neutron [req-a4d61dfb-9560-4909-92d7-24a06f1cda31 req-4531d717-9832-4e2f-bfc0-107138f2a73d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updated VIF entry in instance network info cache for port c058f34b-5e9c-4f7b-888f-9d66a5cfaf85. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG nova.network.neutron [req-a4d61dfb-9560-4909-92d7-24a06f1cda31 req-4531d717-9832-4e2f-bfc0-107138f2a73d service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updating instance_info_cache with network_info: [{"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a4d61dfb-9560-4909-92d7-24a06f1cda31 req-4531d717-9832-4e2f-bfc0-107138f2a73d service nova] Releasing lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-08a843f0-21dc-4fa5-bfd1-f801eeb66096 req-34b8fb63-559a-4d3f-ae81-94cb3900a919 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received event network-changed-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG nova.compute.manager [req-08a843f0-21dc-4fa5-bfd1-f801eeb66096 req-34b8fb63-559a-4d3f-ae81-94cb3900a919 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Refreshing instance network info cache due to event network-changed-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-08a843f0-21dc-4fa5-bfd1-f801eeb66096 req-34b8fb63-559a-4d3f-ae81-94cb3900a919 service nova] Acquiring lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-08a843f0-21dc-4fa5-bfd1-f801eeb66096 req-34b8fb63-559a-4d3f-ae81-94cb3900a919 service nova] Acquired lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG nova.network.neutron [req-08a843f0-21dc-4fa5-bfd1-f801eeb66096 req-34b8fb63-559a-4d3f-ae81-94cb3900a919 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Refreshing network info cache for port c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "10bf2753-7a4c-437e-b58f-29872659ae42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "10bf2753-7a4c-437e-b58f-29872659ae42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:32:14 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:32:14 user nova-compute[70659]: INFO nova.compute.manager [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Terminating instance
Jul 25 17:32:14 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-08a843f0-21dc-4fa5-bfd1-f801eeb66096 req-34b8fb63-559a-4d3f-ae81-94cb3900a919 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updated VIF entry in instance network info cache for port c058f34b-5e9c-4f7b-888f-9d66a5cfaf85. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG nova.network.neutron [req-08a843f0-21dc-4fa5-bfd1-f801eeb66096 req-34b8fb63-559a-4d3f-ae81-94cb3900a919 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updating instance_info_cache with network_info: [{"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-08a843f0-21dc-4fa5-bfd1-f801eeb66096 req-34b8fb63-559a-4d3f-ae81-94cb3900a919 service nova] Releasing lock "refresh_cache-10bf2753-7a4c-437e-b58f-29872659ae42" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:15 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Instance destroyed successfully.
Jul 25 17:32:15 user nova-compute[70659]: DEBUG nova.objects.instance [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'resources' on Instance uuid 10bf2753-7a4c-437e-b58f-29872659ae42 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-570294884',display_name='tempest-TestVolumeBootPattern-server-570294884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-570294884',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7QC9uQNcrFBBHhXb6+i8aDbLy+AmkigPFGq2n70Q94ElSP++KO63c8If7gMAeO1JcU0nisu+1PGDE2+JJPvX/ZM3iLaeFqNAR6ful0rfkF02TtegfxcAlURif+gavTIA==',key_name='tempest-TestVolumeBootPattern-228752096',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:30:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-bykytuk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:30:34Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=10bf2753-7a4c-437e-b58f-29872659ae42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "address": "fa:16:3e:d3:eb:8f", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc058f34b-5e", "ovs_interfaceid": "c058f34b-5e9c-4f7b-888f-9d66a5cfaf85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:eb:8f,bridge_name='br-int',has_traffic_filtering=True,id=c058f34b-5e9c-4f7b-888f-9d66a5cfaf85,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc058f34b-5e') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_vif [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:eb:8f,bridge_name='br-int',has_traffic_filtering=True,id=c058f34b-5e9c-4f7b-888f-9d66a5cfaf85,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc058f34b-5e') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc058f34b-5e, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:32:15 user nova-compute[70659]: INFO os_vif [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:eb:8f,bridge_name='br-int',has_traffic_filtering=True,id=c058f34b-5e9c-4f7b-888f-9d66a5cfaf85,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc058f34b-5e')
Jul 25 17:32:15 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDAymoQn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:32:15 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[274de97e-9d5c-46e7-94c3-cc5409b28e2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c70284-c04d-4215-ac4b-da9e24a9257f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:32:15 user nova-compute[70659]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 (non-flash)
Jul 25 17:32:15 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:32:15 user nova-compute[70659]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 (non-flash)
Jul 25 17:32:15 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd303476d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2'): ({'sdc'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Removing single pathed devices sdc {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[446f9479-a692-43d1-91cb-b5800a612650]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4f4a6f-607c-45cb-a3dd-69792e54f8b4]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flushing IO for device /dev/sdc {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[015737c8-f30b-458d-96da-f141196ad5c2]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[894d1bff-500f-4993-b07c-869d965a5f56]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] SCSI volumes sdc have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8e45bf89',) {{(pid=81811) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddd961e-246d-428d-81b6-eb286f3c084b]: (4, None) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[846326c6-03b4-4d60-9811-411b5a00e788]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:32:15 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[257496f9-f4db-4b23-8940-2d630cde8491]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2, portal: 172.16.0.220,3260]
Jul 25 17:32:16 user nova-compute[70659]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2, portal: 172.16.0.220,3260] successful.
Jul 25 17:32:16 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38447f06-f818-43de-aae4-97dbc76dbcc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf11455-e979-4511-88cb-26dcff037e02]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== disconnect_volume: return (285ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:32:16 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Deleting instance files /opt/stack/data/nova/instances/10bf2753-7a4c-437e-b58f-29872659ae42_del
Jul 25 17:32:16 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Deletion of /opt/stack/data/nova/instances/10bf2753-7a4c-437e-b58f-29872659ae42_del complete
Jul 25 17:32:16 user nova-compute[70659]: INFO nova.compute.manager [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:32:16 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Took 0.56 seconds to deallocate network for instance.
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-708e3ac3-20e3-4f0e-9104-905a288f18ab req-80ca60fb-4fc1-4550-9d94-103b85ce83b0 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received event network-vif-deleted-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received event network-vif-unplugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] Acquiring lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] No waiting events found dispatching network-vif-unplugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received event network-vif-unplugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received event network-vif-plugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] Acquiring lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] Lock "10bf2753-7a4c-437e-b58f-29872659ae42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:32:16 user nova-compute[70659]: DEBUG nova.compute.manager [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] No waiting events found dispatching network-vif-plugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:32:16 user nova-compute[70659]: WARNING nova.compute.manager [req-82f097dc-4da5-4b1d-946d-3b690f8c7419 req-86802f38-f333-4081-8ec2-22b9965d7679 service nova] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Received unexpected event network-vif-plugged-c058f34b-5e9c-4f7b-888f-9d66a5cfaf85 for instance with vm_state active and task_state deleting.
Jul 25 17:32:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:17 user nova-compute[70659]: INFO nova.compute.manager [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Took 0.74 seconds to detach 1 volumes for instance.
Jul 25 17:32:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:32:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:32:17 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:32:17 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:32:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:32:17 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Deleted allocations for instance 10bf2753-7a4c-437e-b58f-29872659ae42
Jul 25 17:32:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-f8c40299-085d-43be-baaf-0e058fe1d2f0 tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "10bf2753-7a4c-437e-b58f-29872659ae42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.745s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:32:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:20 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:25 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:32:26 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:32:26 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=25.15854263305664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance c4941239-6429-44c5-a691-a68aa6304593 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:32:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:32:30 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690306335.7162023, 10bf2753-7a4c-437e-b58f-29872659ae42 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:32:30 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] VM Stopped (Lifecycle Event)
Jul 25 17:32:30 user nova-compute[70659]: DEBUG nova.compute.manager [None req-4154f83f-ab1f-448f-9de4-4a5abecfb64f None None] [instance: 10bf2753-7a4c-437e-b58f-29872659ae42] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:32:30 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:30 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:30 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:35 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:35 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid c4941239-6429-44c5-a691-a68aa6304593 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:32:38 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:32:40 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:32:50 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:55 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:32:58 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:32:58 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 17:33:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:01 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:05 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-a65613dc-b296-4db7-a034-57db5c58f59a req-430f11b3-0b06-4085-90df-dc94bc83e9a3 service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received event network-changed-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG nova.compute.manager [req-a65613dc-b296-4db7-a034-57db5c58f59a req-430f11b3-0b06-4085-90df-dc94bc83e9a3 service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Refreshing instance network info cache due to event network-changed-18b1fc93-6046-48df-88f8-e7fed03e0834. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a65613dc-b296-4db7-a034-57db5c58f59a req-430f11b3-0b06-4085-90df-dc94bc83e9a3 service nova] Acquiring lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a65613dc-b296-4db7-a034-57db5c58f59a req-430f11b3-0b06-4085-90df-dc94bc83e9a3 service nova] Acquired lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG nova.network.neutron [req-a65613dc-b296-4db7-a034-57db5c58f59a req-430f11b3-0b06-4085-90df-dc94bc83e9a3 service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Refreshing network info cache for port 18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "c4941239-6429-44c5-a691-a68aa6304593" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "c4941239-6429-44c5-a691-a68aa6304593" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "c4941239-6429-44c5-a691-a68aa6304593-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:33:17 user nova-compute[70659]: INFO nova.compute.manager [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Terminating instance
Jul 25 17:33:17 user nova-compute[70659]: DEBUG nova.compute.manager [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.network.neutron [req-a65613dc-b296-4db7-a034-57db5c58f59a req-430f11b3-0b06-4085-90df-dc94bc83e9a3 service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updated VIF entry in instance network info cache for port 18b1fc93-6046-48df-88f8-e7fed03e0834. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.network.neutron [req-a65613dc-b296-4db7-a034-57db5c58f59a req-430f11b3-0b06-4085-90df-dc94bc83e9a3 service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [{"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-a65613dc-b296-4db7-a034-57db5c58f59a req-430f11b3-0b06-4085-90df-dc94bc83e9a3 service nova] Releasing lock "refresh_cache-c4941239-6429-44c5-a691-a68aa6304593" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:33:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: c4941239-6429-44c5-a691-a68aa6304593] Instance destroyed successfully.
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.objects.instance [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lazy-loading 'resources' on Instance uuid c4941239-6429-44c5-a691-a68aa6304593 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1763945206',display_name='tempest-TestVolumeBootPattern-server-1763945206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1763945206',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7QC9uQNcrFBBHhXb6+i8aDbLy+AmkigPFGq2n70Q94ElSP++KO63c8If7gMAeO1JcU0nisu+1PGDE2+JJPvX/ZM3iLaeFqNAR6ful0rfkF02TtegfxcAlURif+gavTIA==',key_name='tempest-TestVolumeBootPattern-228752096',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60ec6ce16624cd8af59a77456e647b9',ramdisk_id='',reservation_id='r-7vsfyor4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1024566986',owner_user_name='tempest-TestVolumeBootPattern-1024566986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:28:33Z,user_data=None,user_id='80d4bea31bd94de88d07d0b7bae77086',uuid=c4941239-6429-44c5-a691-a68aa6304593,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converting VIF {"id": "18b1fc93-6046-48df-88f8-e7fed03e0834", "address": "fa:16:3e:40:0c:8b", "network": {"id": "7ca1dbbb-b262-4f3d-8df3-b9975d2221b9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1176854127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60ec6ce16624cd8af59a77456e647b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b1fc93-60", "ovs_interfaceid": "18b1fc93-6046-48df-88f8-e7fed03e0834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:0c:8b,bridge_name='br-int',has_traffic_filtering=True,id=18b1fc93-6046-48df-88f8-e7fed03e0834,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b1fc93-60') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_vif [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:0c:8b,bridge_name='br-int',has_traffic_filtering=True,id=18b1fc93-6046-48df-88f8-e7fed03e0834,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b1fc93-60') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18b1fc93-60, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:33:18 user nova-compute[70659]: INFO os_vif [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:0c:8b,bridge_name='br-int',has_traffic_filtering=True,id=18b1fc93-6046-48df-88f8-e7fed03e0834,network=Network(7ca1dbbb-b262-4f3d-8df3-b9975d2221b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b1fc93-60')
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsFpuSkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:33:18 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[49412e8a-e96a-407d-86da-165646c9aebb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[92de9c2a-a84a-485d-bfbf-32aa58080fdc]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:33:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 (non-flash)
Jul 25 17:33:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd282d5480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a8393c-1ed3-4f68-b874-8b1c0f08396a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92f56c2-e692-4e81-9108-d60c6c5ef39c]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5c604a-f190-44b4-b466-341d769685e9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f455a4d-1f00-4f81-9401-f1d4a31a3e92]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fd2708ad', '/dev/disk/by-id/scsi-1SCST_BIOfd2708ad-c5fae95493212754', '/dev/disk/by-id/scsi-26335666165393534') {{(pid=81811) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4678cc-edae-4432-945b-baf1b3b97239]: (4, None) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[81712d26-db26-4312-9e24-dc5fa714b4aa]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[deac93ae-1ab8-4029-8322-d11a39692600]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260]
Jul 25 17:33:18 user nova-compute[70659]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09, portal: 172.16.0.220,3260] successful.
Jul 25 17:33:18 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4666ea5-b543-4205-8461-d5fa4edb1e09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5846d56-69ba-45a8-a9ba-37b68d3dc496]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] <== disconnect_volume: return (266ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:33:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Deleting instance files /opt/stack/data/nova/instances/c4941239-6429-44c5-a691-a68aa6304593_del
Jul 25 17:33:18 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Deletion of /opt/stack/data/nova/instances/c4941239-6429-44c5-a691-a68aa6304593_del complete
Jul 25 17:33:18 user nova-compute[70659]: INFO nova.compute.manager [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 25 17:33:18 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: c4941239-6429-44c5-a691-a68aa6304593] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:33:18 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: c4941239-6429-44c5-a691-a68aa6304593] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:33:19 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: c4941239-6429-44c5-a691-a68aa6304593] Took 0.52 seconds to deallocate network for instance.
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-34362317-ea5a-4003-af94-25185b3f91c8 req-abb0734c-0e7d-4578-b278-9777c980081b service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received event network-vif-deleted-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:33:19 user nova-compute[70659]: INFO nova.compute.manager [req-34362317-ea5a-4003-af94-25185b3f91c8 req-abb0734c-0e7d-4578-b278-9777c980081b service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Neutron deleted interface 18b1fc93-6046-48df-88f8-e7fed03e0834; detaching it from the instance and deleting it from the info cache
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.network.neutron [req-34362317-ea5a-4003-af94-25185b3f91c8 req-abb0734c-0e7d-4578-b278-9777c980081b service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-34362317-ea5a-4003-af94-25185b3f91c8 req-abb0734c-0e7d-4578-b278-9777c980081b service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Detach interface failed, port_id=18b1fc93-6046-48df-88f8-e7fed03e0834, reason: Instance c4941239-6429-44c5-a691-a68aa6304593 could not be found. {{(pid=70659) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received event network-vif-unplugged-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] Acquiring lock "c4941239-6429-44c5-a691-a68aa6304593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] No waiting events found dispatching network-vif-unplugged-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received event network-vif-unplugged-18b1fc93-6046-48df-88f8-e7fed03e0834 for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received event network-vif-plugged-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] Acquiring lock "c4941239-6429-44c5-a691-a68aa6304593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] Lock "c4941239-6429-44c5-a691-a68aa6304593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.compute.manager [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] No waiting events found dispatching network-vif-plugged-18b1fc93-6046-48df-88f8-e7fed03e0834 {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:33:19 user nova-compute[70659]: WARNING nova.compute.manager [req-aaddbf69-9865-4cf3-b3de-374e7bde6a06 req-f55de254-2e4a-4946-8264-59bdfed445fe service nova] [instance: c4941239-6429-44c5-a691-a68aa6304593] Received unexpected event network-vif-plugged-18b1fc93-6046-48df-88f8-e7fed03e0834 for instance with vm_state active and task_state deleting.
Jul 25 17:33:19 user nova-compute[70659]: INFO nova.compute.manager [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] [instance: c4941239-6429-44c5-a691-a68aa6304593] Took 0.75 seconds to detach 1 volumes for instance.
Jul 25 17:33:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:33:19 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:33:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:33:20 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Deleted allocations for instance c4941239-6429-44c5-a691-a68aa6304593
Jul 25 17:33:20 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-51a975e2-0caa-4918-a4bd-47245d9b4d6c tempest-TestVolumeBootPattern-1024566986 tempest-TestVolumeBootPattern-1024566986-project-member] Lock "c4941239-6429-44c5-a691-a68aa6304593" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.689s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:33:22 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:33:27 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:33:27 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:33:27 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.15764617919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:33:27 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:33:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:33:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:31 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:33 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690306398.2086403, c4941239-6429-44c5-a691-a68aa6304593 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:33:33 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: c4941239-6429-44c5-a691-a68aa6304593] VM Stopped (Lifecycle Event)
Jul 25 17:33:33 user nova-compute[70659]: DEBUG nova.compute.manager [None req-6fbe83f9-118b-4165-b416-446f303fdec0 None None] [instance: c4941239-6429-44c5-a691-a68aa6304593] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:33:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:34 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:35 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:33:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:33:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:33:39 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 17:33:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:33:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:33:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:33:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:34:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:15 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:19 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:22 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:27 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:34:28 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:34:29 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:34:29 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:34:29 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=25.15178680419922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:34:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:34:32 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:33 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:34:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:34:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:34:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 17:34:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:34:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:56 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:34:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:00 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Starting instance... {{(pid=70659) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70659) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 17:35:05 user nova-compute[70659]: INFO nova.compute.claims [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Claim successful on node user
Jul 25 17:35:05 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Start building networks asynchronously for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Allocating IP information in the background. {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG nova.network.neutron [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] allocate_for_instance() {{(pid=70659) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 17:35:05 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 17:35:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Start building block device mappings for instance. {{(pid=70659) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 17:35:05 user nova-compute[70659]: DEBUG nova.policy [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd48404544f646a5a2fad0f9116ec6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a384cb0a5441f3a20d33605712e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70659) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Start spawning the instance on the hypervisor. {{(pid=70659) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Creating instance directory {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 17:35:06 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Creating image(s)
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "/opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "/opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.154s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.167s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk 1073741824 {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261,backing_fmt=raw /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk 1073741824" returned: 0 in 0.065s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "445037ade5ee2dbec9c7e9f2b63d59f72f392261" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/445037ade5ee2dbec9c7e9f2b63d59f72f392261 --force-share --output=json" returned: 0 in 0.161s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk. size=1073741824 {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG nova.virt.disk.api [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Cannot resize image /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk to a smaller size. {{(pid=70659) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'migration_context' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Created local disks {{(pid=70659) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Ensure instance console log exists: /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/console.log {{(pid=70659) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.013s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:35:06 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:35:07 user nova-compute[70659]: DEBUG nova.network.neutron [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Successfully created port: 625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 17:35:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Successfully updated port: 625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Building network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-53861d19-6a8e-4f60-9afb-6abfc5b3ce5b req-02e2d038-e510-4d9f-993b-713ceb65039a service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-changed-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.compute.manager [req-53861d19-6a8e-4f60-9afb-6abfc5b3ce5b req-02e2d038-e510-4d9f-993b-713ceb65039a service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Refreshing instance network info cache due to event network-changed-625f266b-2591-4cf1-a454-b753ac3ed5aa. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-53861d19-6a8e-4f60-9afb-6abfc5b3ce5b req-02e2d038-e510-4d9f-993b-713ceb65039a service nova] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Instance cache missing network info. {{(pid=70659) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.neutron [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Instance network_info: |[{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70659) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-53861d19-6a8e-4f60-9afb-6abfc5b3ce5b req-02e2d038-e510-4d9f-993b-713ceb65039a service nova] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-53861d19-6a8e-4f60-9afb-6abfc5b3ce5b req-02e2d038-e510-4d9f-993b-713ceb65039a service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Refreshing network info cache for port 625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Start _get_guest_xml network_info=[{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'image_id': 'cf818516-7014-4487-8846-a63b84aa1a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 17:35:08 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:35:08 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] CPU controller missing on host. {{(pid=70659) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.host [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] CPU controller found on host. {{(pid=70659) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70659) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T16:41:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T16:42:05Z,direct_url=<?>,disk_format='qcow2',id=cf818516-7014-4487-8846-a63b84aa1a5a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a833a3f65d9d4559aaabe28a4cb1bd01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T16:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Flavor limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Image limits 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Flavor pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Image pref 0:0:0 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Got 1 possible topologies {{(pid=70659) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.hardware [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70659) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-435911274',display_name='tempest-SnapshotDataIntegrityTests-server-435911274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-435911274',id=52,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9VDREs+EtMOSA4c21s9+0O+7NycTXxrSp9+EeOZym5A7sGp34I8VR9fx2mxVk9r7kI0nFgkzb8HkyUZIlQfj9H6BMat0qparV+4tS18ash9haaiJRxu0PAsBCXU+gVSw==',key_name='tempest-keypair-1681928316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91a384cb0a5441f3a20d33605712e3fe',ramdisk_id='',reservation_id='r-no2xyoak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1769443324',owner_user_name='tempest-SnapshotDataIntegrityTests-1769443324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd48404544f646a5a2fad0f9116ec6ad',uuid=a0f5f3b5-c497-4e20-9d91-cb9e20da6e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70659) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Converting VIF {"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a9:08,bridge_name='br-int',has_traffic_filtering=True,id=625f266b-2591-4cf1-a454-b753ac3ed5aa,network=Network(976a1c4a-2f56-435b-9f9d-7ebb275f46da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625f266b-25') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.objects.instance [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'pci_devices' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] End _get_guest_xml xml=<domain type="kvm">
Jul 25 17:35:08 user nova-compute[70659]:   <uuid>a0f5f3b5-c497-4e20-9d91-cb9e20da6e52</uuid>
Jul 25 17:35:08 user nova-compute[70659]:   <name>instance-00000034</name>
Jul 25 17:35:08 user nova-compute[70659]:   <memory>524288</memory>
Jul 25 17:35:08 user nova-compute[70659]:   <vcpu>1</vcpu>
Jul 25 17:35:08 user nova-compute[70659]:   <metadata>
Jul 25 17:35:08 user nova-compute[70659]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 17:35:08 user nova-compute[70659]:       <nova:package version="0.0.0"/>
Jul 25 17:35:08 user nova-compute[70659]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-435911274</nova:name>
Jul 25 17:35:08 user nova-compute[70659]:       <nova:creationTime>2023-07-25 17:35:08</nova:creationTime>
Jul 25 17:35:08 user nova-compute[70659]:       <nova:flavor name="m1.tiny">
Jul 25 17:35:08 user nova-compute[70659]:         <nova:memory>512</nova:memory>
Jul 25 17:35:08 user nova-compute[70659]:         <nova:disk>1</nova:disk>
Jul 25 17:35:08 user nova-compute[70659]:         <nova:swap>0</nova:swap>
Jul 25 17:35:08 user nova-compute[70659]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 17:35:08 user nova-compute[70659]:         <nova:vcpus>1</nova:vcpus>
Jul 25 17:35:08 user nova-compute[70659]:       </nova:flavor>
Jul 25 17:35:08 user nova-compute[70659]:       <nova:owner>
Jul 25 17:35:08 user nova-compute[70659]:         <nova:user uuid="bd48404544f646a5a2fad0f9116ec6ad">tempest-SnapshotDataIntegrityTests-1769443324-project-member</nova:user>
Jul 25 17:35:08 user nova-compute[70659]:         <nova:project uuid="91a384cb0a5441f3a20d33605712e3fe">tempest-SnapshotDataIntegrityTests-1769443324</nova:project>
Jul 25 17:35:08 user nova-compute[70659]:       </nova:owner>
Jul 25 17:35:08 user nova-compute[70659]:       <nova:root type="image" uuid="cf818516-7014-4487-8846-a63b84aa1a5a"/>
Jul 25 17:35:08 user nova-compute[70659]:       <nova:ports>
Jul 25 17:35:08 user nova-compute[70659]:         <nova:port uuid="625f266b-2591-4cf1-a454-b753ac3ed5aa">
Jul 25 17:35:08 user nova-compute[70659]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 17:35:08 user nova-compute[70659]:         </nova:port>
Jul 25 17:35:08 user nova-compute[70659]:       </nova:ports>
Jul 25 17:35:08 user nova-compute[70659]:     </nova:instance>
Jul 25 17:35:08 user nova-compute[70659]:   </metadata>
Jul 25 17:35:08 user nova-compute[70659]:   <sysinfo type="smbios">
Jul 25 17:35:08 user nova-compute[70659]:     <system>
Jul 25 17:35:08 user nova-compute[70659]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 17:35:08 user nova-compute[70659]:       <entry name="product">OpenStack Nova</entry>
Jul 25 17:35:08 user nova-compute[70659]:       <entry name="version">0.0.0</entry>
Jul 25 17:35:08 user nova-compute[70659]:       <entry name="serial">a0f5f3b5-c497-4e20-9d91-cb9e20da6e52</entry>
Jul 25 17:35:08 user nova-compute[70659]:       <entry name="uuid">a0f5f3b5-c497-4e20-9d91-cb9e20da6e52</entry>
Jul 25 17:35:08 user nova-compute[70659]:       <entry name="family">Virtual Machine</entry>
Jul 25 17:35:08 user nova-compute[70659]:     </system>
Jul 25 17:35:08 user nova-compute[70659]:   </sysinfo>
Jul 25 17:35:08 user nova-compute[70659]:   <os>
Jul 25 17:35:08 user nova-compute[70659]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 17:35:08 user nova-compute[70659]:     <boot dev="hd"/>
Jul 25 17:35:08 user nova-compute[70659]:     <smbios mode="sysinfo"/>
Jul 25 17:35:08 user nova-compute[70659]:   </os>
Jul 25 17:35:08 user nova-compute[70659]:   <features>
Jul 25 17:35:08 user nova-compute[70659]:     <acpi/>
Jul 25 17:35:08 user nova-compute[70659]:     <apic/>
Jul 25 17:35:08 user nova-compute[70659]:     <vmcoreinfo/>
Jul 25 17:35:08 user nova-compute[70659]:   </features>
Jul 25 17:35:08 user nova-compute[70659]:   <clock offset="utc">
Jul 25 17:35:08 user nova-compute[70659]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 17:35:08 user nova-compute[70659]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 17:35:08 user nova-compute[70659]:     <timer name="hpet" present="no"/>
Jul 25 17:35:08 user nova-compute[70659]:   </clock>
Jul 25 17:35:08 user nova-compute[70659]:   <cpu mode="custom" match="exact">
Jul 25 17:35:08 user nova-compute[70659]:     <model>Nehalem</model>
Jul 25 17:35:08 user nova-compute[70659]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 17:35:08 user nova-compute[70659]:   </cpu>
Jul 25 17:35:08 user nova-compute[70659]:   <devices>
Jul 25 17:35:08 user nova-compute[70659]:     <disk type="file" device="disk">
Jul 25 17:35:08 user nova-compute[70659]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 17:35:08 user nova-compute[70659]:       <source file="/opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk"/>
Jul 25 17:35:08 user nova-compute[70659]:       <target dev="vda" bus="virtio"/>
Jul 25 17:35:08 user nova-compute[70659]:     </disk>
Jul 25 17:35:08 user nova-compute[70659]:     <interface type="ethernet">
Jul 25 17:35:08 user nova-compute[70659]:       <mac address="fa:16:3e:c5:a9:08"/>
Jul 25 17:35:08 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:35:08 user nova-compute[70659]:       <mtu size="1442"/>
Jul 25 17:35:08 user nova-compute[70659]:       <target dev="tap625f266b-25"/>
Jul 25 17:35:08 user nova-compute[70659]:     </interface>
Jul 25 17:35:08 user nova-compute[70659]:     <serial type="pty">
Jul 25 17:35:08 user nova-compute[70659]:       <log file="/opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/console.log" append="off"/>
Jul 25 17:35:08 user nova-compute[70659]:     </serial>
Jul 25 17:35:08 user nova-compute[70659]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 17:35:08 user nova-compute[70659]:     <video>
Jul 25 17:35:08 user nova-compute[70659]:       <model type="virtio"/>
Jul 25 17:35:08 user nova-compute[70659]:     </video>
Jul 25 17:35:08 user nova-compute[70659]:     <rng model="virtio">
Jul 25 17:35:08 user nova-compute[70659]:       <backend model="random">/dev/urandom</backend>
Jul 25 17:35:08 user nova-compute[70659]:     </rng>
Jul 25 17:35:08 user nova-compute[70659]:     <controller type="usb" index="0" model="none"/>
Jul 25 17:35:08 user nova-compute[70659]:     <memballoon model="virtio">
Jul 25 17:35:08 user nova-compute[70659]:       <stats period="10"/>
Jul 25 17:35:08 user nova-compute[70659]:     </memballoon>
Jul 25 17:35:08 user nova-compute[70659]:   </devices>
Jul 25 17:35:08 user nova-compute[70659]: </domain>
Jul 25 17:35:08 user nova-compute[70659]:  {{(pid=70659) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-435911274',display_name='tempest-SnapshotDataIntegrityTests-server-435911274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-435911274',id=52,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9VDREs+EtMOSA4c21s9+0O+7NycTXxrSp9+EeOZym5A7sGp34I8VR9fx2mxVk9r7kI0nFgkzb8HkyUZIlQfj9H6BMat0qparV+4tS18ash9haaiJRxu0PAsBCXU+gVSw==',key_name='tempest-keypair-1681928316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91a384cb0a5441f3a20d33605712e3fe',ramdisk_id='',reservation_id='r-no2xyoak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1769443324',owner_user_name='tempest-SnapshotDataIntegrityTests-1769443324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T17:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd48404544f646a5a2fad0f9116ec6ad',uuid=a0f5f3b5-c497-4e20-9d91-cb9e20da6e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Converting VIF {"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a9:08,bridge_name='br-int',has_traffic_filtering=True,id=625f266b-2591-4cf1-a454-b753ac3ed5aa,network=Network(976a1c4a-2f56-435b-9f9d-7ebb275f46da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625f266b-25') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG os_vif [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a9:08,bridge_name='br-int',has_traffic_filtering=True,id=625f266b-2591-4cf1-a454-b753ac3ed5aa,network=Network(976a1c4a-2f56-435b-9f9d-7ebb275f46da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625f266b-25') {{(pid=70659) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap625f266b-25, may_exist=True, interface_attrs={}) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap625f266b-25, col_values=(('external_ids', {'iface-id': '625f266b-2591-4cf1-a454-b753ac3ed5aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:a9:08', 'vm-uuid': 'a0f5f3b5-c497-4e20-9d91-cb9e20da6e52'}),), if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:08 user nova-compute[70659]: INFO os_vif [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a9:08,bridge_name='br-int',has_traffic_filtering=True,id=625f266b-2591-4cf1-a454-b753ac3ed5aa,network=Network(976a1c4a-2f56-435b-9f9d-7ebb275f46da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625f266b-25')
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No VIF found with MAC fa:16:3e:c5:a9:08, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-53861d19-6a8e-4f60-9afb-6abfc5b3ce5b req-02e2d038-e510-4d9f-993b-713ceb65039a service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updated VIF entry in instance network info cache for port 625f266b-2591-4cf1-a454-b753ac3ed5aa. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG nova.network.neutron [req-53861d19-6a8e-4f60-9afb-6abfc5b3ce5b req-02e2d038-e510-4d9f-993b-713ceb65039a service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:35:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-53861d19-6a8e-4f60-9afb-6abfc5b3ce5b req-02e2d038-e510-4d9f-993b-713ceb65039a service nova] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:35:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:10 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-0644d595-d359-42a7-9ed7-c39e3d067678 req-7f0c3d3d-0713-47c9-8797-dd42b5cada8e service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:35:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0644d595-d359-42a7-9ed7-c39e3d067678 req-7f0c3d3d-0713-47c9-8797-dd42b5cada8e service nova] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:35:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0644d595-d359-42a7-9ed7-c39e3d067678 req-7f0c3d3d-0713-47c9-8797-dd42b5cada8e service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:35:10 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-0644d595-d359-42a7-9ed7-c39e3d067678 req-7f0c3d3d-0713-47c9-8797-dd42b5cada8e service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:35:10 user nova-compute[70659]: DEBUG nova.compute.manager [req-0644d595-d359-42a7-9ed7-c39e3d067678 req-7f0c3d3d-0713-47c9-8797-dd42b5cada8e service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] No waiting events found dispatching network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:35:10 user nova-compute[70659]: WARNING nova.compute.manager [req-0644d595-d359-42a7-9ed7-c39e3d067678 req-7f0c3d3d-0713-47c9-8797-dd42b5cada8e service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received unexpected event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa for instance with vm_state building and task_state spawning.
Jul 25 17:35:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:11 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690306512.527394, a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 => Resumed> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:35:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] VM Resumed (Lifecycle Event)
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Instance event wait completed in 0 seconds for  {{(pid=70659) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Guest created on hypervisor {{(pid=70659) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 17:35:12 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Instance spawned successfully.
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Found default for hw_cdrom_bus of ide {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Found default for hw_disk_bus of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Found default for hw_input_bus of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Found default for hw_pointer_model of None {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Found default for hw_video_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Found default for hw_vif_model of virtio {{(pid=70659) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 17:35:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.virt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Emitting event <LifecycleEvent: 1690306512.5292926, a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 => Started> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:35:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] VM Started (Lifecycle Event)
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-24493e93-7c59-469b-9eab-88bf454712af req-3d321ab5-fe36-4923-b087-13d41f2c2465 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-24493e93-7c59-469b-9eab-88bf454712af req-3d321ab5-fe36-4923-b087-13d41f2c2465 service nova] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-24493e93-7c59-469b-9eab-88bf454712af req-3d321ab5-fe36-4923-b087-13d41f2c2465 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-24493e93-7c59-469b-9eab-88bf454712af req-3d321ab5-fe36-4923-b087-13d41f2c2465 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.compute.manager [req-24493e93-7c59-469b-9eab-88bf454712af req-3d321ab5-fe36-4923-b087-13d41f2c2465 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] No waiting events found dispatching network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:35:12 user nova-compute[70659]: WARNING nova.compute.manager [req-24493e93-7c59-469b-9eab-88bf454712af req-3d321ab5-fe36-4923-b087-13d41f2c2465 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received unexpected event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa for instance with vm_state building and task_state spawning.
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70659) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 17:35:12 user nova-compute[70659]: INFO nova.compute.manager [None req-f46683cd-2861-421f-9369-8c99a381897a None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 17:35:12 user nova-compute[70659]: INFO nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Took 6.66 seconds to spawn the instance on the hypervisor.
Jul 25 17:35:12 user nova-compute[70659]: DEBUG nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:35:12 user nova-compute[70659]: INFO nova.compute.manager [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Took 7.29 seconds to build instance.
Jul 25 17:35:12 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-ee61dec5-5abe-4999-9f85-7f0ea3931d76 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.407s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:35:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:35:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:35:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:35:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:35:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:21 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:35:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:24 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:35:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:28 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:35:28 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:35:28 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:35:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:35:30 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:35:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:35:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:35:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:35:30 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:35:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:35:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:35:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:35:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:35:31 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:35:31 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:35:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8513MB free_disk=25.113994598388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:35:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:35:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:35:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:35:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:35:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:35:31 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:35:31 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:35:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:35:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:35:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:33 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:35:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:35:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:35:41 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:35:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:35:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:35:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:36:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:36:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:36:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:36:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:22 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:36:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:36:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:36:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:36:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:24 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:28 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:36:30 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:36:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:36:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:36:30 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:36:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:36:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:36:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:36:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:36:31 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:36:31 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:36:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=25.11046600341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:36:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:36:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:36:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:36:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:36:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:36:31 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:36:31 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:36:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:36:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:36:32 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:33 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:33 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:36:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:40 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:36:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:36:43 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:36:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:36:43 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:36:43 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:36:43 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:36:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:36:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:36:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:36:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:36:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:36:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-c13b8ce7-4bdd-49bf-9c1d-3f76af6c2e58 req-77448b54-35f2-44cf-aeae-f164d16a9845 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-changed-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:36:56 user nova-compute[70659]: DEBUG nova.compute.manager [req-c13b8ce7-4bdd-49bf-9c1d-3f76af6c2e58 req-77448b54-35f2-44cf-aeae-f164d16a9845 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Refreshing instance network info cache due to event network-changed-625f266b-2591-4cf1-a454-b753ac3ed5aa. {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 17:36:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c13b8ce7-4bdd-49bf-9c1d-3f76af6c2e58 req-77448b54-35f2-44cf-aeae-f164d16a9845 service nova] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:36:56 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c13b8ce7-4bdd-49bf-9c1d-3f76af6c2e58 req-77448b54-35f2-44cf-aeae-f164d16a9845 service nova] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:36:56 user nova-compute[70659]: DEBUG nova.network.neutron [req-c13b8ce7-4bdd-49bf-9c1d-3f76af6c2e58 req-77448b54-35f2-44cf-aeae-f164d16a9845 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Refreshing network info cache for port 625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 17:36:57 user nova-compute[70659]: DEBUG nova.network.neutron [req-c13b8ce7-4bdd-49bf-9c1d-3f76af6c2e58 req-77448b54-35f2-44cf-aeae-f164d16a9845 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updated VIF entry in instance network info cache for port 625f266b-2591-4cf1-a454-b753ac3ed5aa. {{(pid=70659) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 17:36:57 user nova-compute[70659]: DEBUG nova.network.neutron [req-c13b8ce7-4bdd-49bf-9c1d-3f76af6c2e58 req-77448b54-35f2-44cf-aeae-f164d16a9845 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:36:57 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-c13b8ce7-4bdd-49bf-9c1d-3f76af6c2e58 req-77448b54-35f2-44cf-aeae-f164d16a9845 service nova] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:36:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:36:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:36:59 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:37:00 user nova-compute[70659]: INFO nova.compute.manager [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attaching volume 31ad8685-8e51-46f5-9576-085baad1cb38 to /dev/vdb
Jul 25 17:37:00 user nova-compute[70659]: DEBUG os_brick.utils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b6e530-57ad-4598-8e26-1b3fc6e49db5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e09d51-21b2-418b-b4ba-be5940e76333]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[80613900-5847-45ff-a03f-cfd23be3ca9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b87a0bf-6080-483b-8862-771057c56c55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:37:00 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:37:00 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7854aab2-ddb0-4fb0-a880-68d135f19504]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG os_brick.utils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:37:00 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating existing volume attachment record: 2ea63573-e63f-4c86-8c7e-4f267432e63c {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:37:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BenGTXow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:37:06 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:37:06 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:37:06 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8b07aa-3214-46ee-a288-b025818ebea2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:37:06 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f082027-665c-4ece-94bb-f48dd50a5647]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38] added
Jul 25 17:37:06 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e347a82-7cc2-4c42-94f6-76457777f22b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31964911-13f5-4fd2-b4e6-40e6f9577f1c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BenGTXow {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BenGTXow" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d02508-ea8f-4c18-871f-c5e0e6e80b1f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BenGTXow'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e37a40-24c6-461b-ab33-f5f60bdb10dc]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0c6df4-9bdd-44ae-ae90-6bdc2b7bbb20]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:37:06 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:37:06 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:37:06 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 17:37:06 user nova-compute[70659]: 
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[685850bc-d2e3-46c7-af81-288e4beff499]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38, portal: 172.16.0.220,3260]
Jul 25 17:37:06 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38, portal: 172.16.0.220,3260] successful.
Jul 25 17:37:06 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fac52f1-8380-4589-a6fa-399c2c119f7e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd7bf33-4757-42f9-9e21-d43015073517]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 (non-flash)
Jul 25 17:37:06 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 (non-flash)
Jul 25 17:37:06 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e6887-6a0a-47f9-9c51-32a109a5e9c5]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:06 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:37:07 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:37:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BenGTXow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:37:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:37:07 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26432653661323831', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:37:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432653661323831', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:37:07 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:37:07 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:37:07 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:37:07 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:37:07 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:37:07 user nova-compute[70659]:   <serial>31ad8685-8e51-46f5-9576-085baad1cb38</serial>
Jul 25 17:37:07 user nova-compute[70659]: </disk>
Jul 25 17:37:07 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:37:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:37:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:37:08 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No VIF found with MAC fa:16:3e:c5:a9:08, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:37:08 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d05997b7-1874-41db-866d-570778e6a7dc tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.166s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:37:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:20 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 17:37:20 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 17:37:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:37:23 user nova-compute[70659]: INFO nova.compute.manager [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Detaching volume 31ad8685-8e51-46f5-9576-085baad1cb38
Jul 25 17:37:23 user nova-compute[70659]: INFO nova.virt.block_device [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attempting to driver detach volume 31ad8685-8e51-46f5-9576-085baad1cb38 from mountpoint /dev/vdb
Jul 25 17:37:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Attempting to detach device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:37:23 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:37:23 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:37:23 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:37:23 user nova-compute[70659]:   <serial>31ad8685-8e51-46f5-9576-085baad1cb38</serial>
Jul 25 17:37:23 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:37:23 user nova-compute[70659]: </disk>
Jul 25 17:37:23 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:37:23 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully detached device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the persistent domain config.
Jul 25 17:37:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:37:23 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:37:23 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:37:23 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:37:23 user nova-compute[70659]:   <serial>31ad8685-8e51-46f5-9576-085baad1cb38</serial>
Jul 25 17:37:23 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:37:23 user nova-compute[70659]: </disk>
Jul 25 17:37:23 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690306643.6801338, a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:37:23 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully detached device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the live domain config.
Jul 25 17:37:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BenGTXow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:37:23 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3dcd63-f78a-4b29-aa1e-8eb311c5204d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a6c61b-3b16-469d-8b45-b0648ee01064]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 (non-flash)
Jul 25 17:37:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 (non-flash)
Jul 25 17:37:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30499240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb54eab-9d51-4a15-957d-8d1cab400b6b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c9cfa-fcd6-4a9a-b547-44d4ff665f1f]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[028997ff-f434-48ec-8f03-da185e15605b]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e1741-119d-46b9-b555-2efdaf9c631e]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e460f-37d6-4354-baa1-ae5e99dc130f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baaa8ca-2663-441c-b92b-ddfe5877ed19]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38, portal: 172.16.0.220,3260]
Jul 25 17:37:23 user nova-compute[70659]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38, portal: 172.16.0.220,3260] successful.
Jul 25 17:37:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad8685-8e51-46f5-9576-085baad1cb38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41048e1-06e0-495a-8bb0-ce0d8952a6bd]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== disconnect_volume: return (271ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:37:23 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:37:24 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:24 user nova-compute[70659]: DEBUG nova.objects.instance [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:37:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-4dfa1d76-e106-45cc-a812-3af793399372 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.589s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:37:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:29 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:37:30 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:37:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:37:30 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:37:30 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:37:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:37:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:37:31 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:37:31 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:37:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.101242065429688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:37:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:37:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:37:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:37:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:37:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:37:31 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:37:31 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:37:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:37:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:37:32 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:35 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:40 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:37:44 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:37:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:37:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:04 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:04 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 17:38:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:38:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:38:15 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:38:16 user nova-compute[70659]: INFO nova.compute.manager [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attaching volume 2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f to /dev/vdb
Jul 25 17:38:16 user nova-compute[70659]: DEBUG os_brick.utils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d91364-de89-4c3a-afe2-70a031ad09c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b3b776-b149-4809-83c5-5cab1ab2379a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bf1513-fe14-481c-bede-8641cc74e45e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4082354-7613-4bc6-ae68-c877bbf43144]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:38:16 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:38:16 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c317c3dd-5962-48be-8932-9259d28da137]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG os_brick.utils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:38:16 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating existing volume attachment record: c406519d-e73f-48a5-88c1-f8dd333e6a20 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:38:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISMeAdBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:38:22 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:38:22 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:38:22 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcb56b4-bb40-4272-a299-41601709dcd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:38:22 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9466c1af-c604-452e-8a80-8b134dc72d3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f] added
Jul 25 17:38:22 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[650e2ee0-f8ff-4d7d-a261-19459a3370ff]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[49deb4fb-0266-42ab-8bdf-b3e7ecffe697]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISMeAdBL {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISMeAdBL" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[433af6f9-1658-4d34-a015-2fac72574592]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ISMeAdBL'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7ac993-f159-4c9b-9c98-012f1b224246]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd1c220-5bec-4e08-b5ae-5f61fca6d0a4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:38:22 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:38:22 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:38:22 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 17:38:22 user nova-compute[70659]: 
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2dae35-baa7-44cf-b031-6f9522bc6f47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f, portal: 172.16.0.220,3260]
Jul 25 17:38:22 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f, portal: 172.16.0.220,3260] successful.
Jul 25 17:38:22 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:22 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6712c7-6815-4739-9fc0-bde6ca60d071]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[96289e02-f038-4fac-815d-48318c6d972a]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f (non-flash)
Jul 25 17:38:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f (non-flash)
Jul 25 17:38:23 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94151ed-64de-47bc-b47a-337d95dcad41]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:38:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISMeAdBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23438623633346133', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438623633346133', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG nova.objects.instance [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:38:24 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:38:24 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:38:24 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:38:24 user nova-compute[70659]:   <serial>2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f</serial>
Jul 25 17:38:24 user nova-compute[70659]: </disk>
Jul 25 17:38:24 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No VIF found with MAC fa:16:3e:c5:a9:08, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:38:24 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-7867db60-02d8-4e78-9dfe-b7ad28bcb8e8 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.191s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:38:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:38:26 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:38:26 user nova-compute[70659]: INFO nova.compute.manager [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Detaching volume 2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f
Jul 25 17:38:26 user nova-compute[70659]: INFO nova.virt.block_device [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attempting to driver detach volume 2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f from mountpoint /dev/vdb
Jul 25 17:38:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Attempting to detach device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:38:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:38:26 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:38:26 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:38:26 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:38:26 user nova-compute[70659]:   <serial>2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f</serial>
Jul 25 17:38:26 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:38:26 user nova-compute[70659]: </disk>
Jul 25 17:38:26 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:38:26 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully detached device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the persistent domain config.
Jul 25 17:38:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:38:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:38:26 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:38:26 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:38:26 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:38:26 user nova-compute[70659]:   <serial>2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f</serial>
Jul 25 17:38:26 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:38:26 user nova-compute[70659]: </disk>
Jul 25 17:38:26 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690306707.1377604, a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:38:27 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully detached device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the live domain config.
Jul 25 17:38:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISMeAdBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:38:27 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c22454-58b6-4119-ac58-8c38c861e94c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae1d4d1-d004-4418-930b-d7ba0199563d]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f (non-flash)
Jul 25 17:38:27 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f (non-flash)
Jul 25 17:38:27 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30365900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b14476-113c-4628-a486-e16ac0573b9d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abcb630-41a9-4a65-a7d6-c359ab1c748e]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b782db-bba4-4833-950e-a51d601a1bfb]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc13d5c-c8aa-45d5-9910-e547fb3dae16]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b3758b-3edc-4156-9471-8934ceed8846]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a4f63-deeb-4000-bb2a-a52d6851243b]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f, portal: 172.16.0.220,3260]
Jul 25 17:38:27 user nova-compute[70659]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f, portal: 172.16.0.220,3260] successful.
Jul 25 17:38:27 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2627ed7a-32f4-4fc2-9a9c-9c0033fbdc1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca141f5a-e218-47ee-8660-98636eb638c9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== disconnect_volume: return (304ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:38:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:28 user nova-compute[70659]: DEBUG nova.objects.instance [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:38:28 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-731d7029-8525-42d7-a008-68f156c9ba37 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.752s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:38:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:38:31 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:38:32 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:38:32 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.10028839111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing inventories for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating ProviderTree inventory for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Updating inventory in ProviderTree for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing aggregate associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, aggregates: None {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Refreshing trait associations for resource provider 9f90033f-5d23-4363-83e3-e56f7852cf56, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI {{(pid=70659) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:38:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:38:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:38:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:38 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:41 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:38:46 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:38:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:38:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:39:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG nova.objects.instance [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:39:19 user nova-compute[70659]: INFO nova.compute.manager [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attaching volume cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 to /dev/vdb
Jul 25 17:39:19 user nova-compute[70659]: DEBUG os_brick.utils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[761adf5d-98b0-4ee3-95f2-9ab30cd33f52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a526ad4-3a91-4a58-9f35-6f1fbc314cae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[06052202-ed69-4d0d-82a3-acf419b23645]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[da74ae5b-07a7-4380-abf6-a3df863025c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:39:19 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:39:19 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecaaa4c-f0de-42df-92c8-cd6f871a3073]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG os_brick.utils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:39:19 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating existing volume attachment record: 0058781e-d90f-425e-8ca3-714b8f60dc71 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:39:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFAhZOHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:39:26 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:39:26 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:39:26 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a1cff-8b5b-46e7-9659-5daba47b08c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:39:26 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de0b7e9-3e5b-4267-acba-cfe7caa4e374]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0] added
Jul 25 17:39:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfa108a-d38b-4f6e-b252-7d8cf7d7b7d9]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd58a563-06fd-4aff-9264-a7abe73a36a0]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFAhZOHX {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFAhZOHX" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[763720af-74ed-4abe-bf91-a9ffbd8c0865]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mFAhZOHX'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[38011428-7177-48f7-a007-59104d3cee85]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[342ce7ea-1cfe-4f16-9b8e-7bea37a4cf6b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:39:26 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:39:26 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:39:26 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 17:39:26 user nova-compute[70659]: 
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f41ddc-b07d-428b-9633-92d1479abb31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0, portal: 172.16.0.220,3260]
Jul 25 17:39:26 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0, portal: 172.16.0.220,3260] successful.
Jul 25 17:39:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3690d0e-f3a5-4fc6-96f7-8311ec41d532]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1ded73-5741-48c0-9999-0b2039e09713]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 (non-flash)
Jul 25 17:39:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 (non-flash)
Jul 25 17:39:26 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d1d641-a084-4dd2-a63c-4f75c9f1388e]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:26 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFAhZOHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23835336664663434', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835336664663434', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG nova.objects.instance [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:39:27 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:39:27 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:39:27 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:39:27 user nova-compute[70659]:   <serial>cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0</serial>
Jul 25 17:39:27 user nova-compute[70659]: </disk>
Jul 25 17:39:27 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No VIF found with MAC fa:16:3e:c5:a9:08, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:39:27 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-3405b6a6-92eb-4840-835e-38f8283f8a14 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.236s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:39:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:39:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:39:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:39:29 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:39:29 user nova-compute[70659]: INFO nova.compute.manager [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Detaching volume cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0
Jul 25 17:39:30 user nova-compute[70659]: INFO nova.virt.block_device [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attempting to driver detach volume cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 from mountpoint /dev/vdb
Jul 25 17:39:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Attempting to detach device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:39:30 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:39:30 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:39:30 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:39:30 user nova-compute[70659]:   <serial>cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0</serial>
Jul 25 17:39:30 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:39:30 user nova-compute[70659]: </disk>
Jul 25 17:39:30 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:39:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully detached device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the persistent domain config.
Jul 25 17:39:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:39:30 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:39:30 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:39:30 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:39:30 user nova-compute[70659]:   <serial>cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0</serial>
Jul 25 17:39:30 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:39:30 user nova-compute[70659]: </disk>
Jul 25 17:39:30 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690306770.4684908, a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:39:30 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully detached device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the live domain config.
Jul 25 17:39:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFAhZOHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:39:30 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac88a336-68d0-4842-ad5d-01ff89009290]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71d8b5c-4e0b-4686-90e4-cd491a9409dc]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 (non-flash)
Jul 25 17:39:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 (non-flash)
Jul 25 17:39:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd30499240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4f4948-46de-4049-a896-1b560b9015b8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4aba91-12e7-4459-ada3-c5b3735fd1d0]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42c771c-3164-49ae-ae66-c72b0304c1ce]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30ebb1-66b2-42f8-8a94-ae06a7ef90ee]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[481383c4-d1ed-49dd-aac8-50cd3367348f]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a202aedc-c9d5-4425-b402-89ac30f2ddd8]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0, portal: 172.16.0.220,3260]
Jul 25 17:39:30 user nova-compute[70659]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0, portal: 172.16.0.220,3260] successful.
Jul 25 17:39:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf83d0c1-d5ad-4506-b44a-3f0142d1e5a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcd739c-1ca2-4d91-b299-8752c15d6249]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== disconnect_volume: return (273ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:39:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:39:31 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:39:31 user nova-compute[70659]: DEBUG nova.objects.instance [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:39:31 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-b473ab3d-7a9d-4905-9cc8-3a2038fb6901 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.558s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:39:32 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:39:33 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:39:33 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.099319458007812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:39:33 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:38 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:39:39 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:39:43 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:39:43 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:39:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:39:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:39:58 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:03 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:08 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:13 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:40:18 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG nova.objects.instance [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:40:23 user nova-compute[70659]: INFO nova.compute.manager [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attaching volume 7d0fe06a-4be8-4994-a0aa-acd26d535097 to /dev/vdb
Jul 25 17:40:23 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG os_brick.utils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fcba01-d2f8-4ebf-9ef2-a1b06e46f262]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:373b5169b58c\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa2e5bf-b9ee-4a18-b699-3815e90d83be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[364557d4-c4fa-4137-8286-59f2b760e617]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966a7a8-267c-48ce-b5d7-ea49b3d60794]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Running cmd (subprocess): nvme version {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] 'nvme version' failed. Not Retrying. {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] nvme not present on system {{(pid=70659) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 17:40:23 user nova-compute[70659]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 17:40:23 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4067129-d34c-4839-96e3-6318d845bf17]: (4, '') {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70659) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.lightos [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] LIGHTOS: no hostnqn found. {{(pid=70659) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG os_brick.utils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:373b5169b58c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:40:23 user nova-compute[70659]: DEBUG nova.virt.block_device [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating existing volume attachment record: 5d4055b0-5fa5-4020-9ba1-5ee9462ce9a4 {{(pid=70659) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 17:40:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:28 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Calling os-brick to attach iSCSI Volume {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezqsDLmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:40:30 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:40:30 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:40:30 user nova-compute[70659]: INFO os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce42dc58-f4e6-448e-9969-705a92c7ed00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 17:40:30 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --interface default --op new {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b5c27b-57fb-417d-af80-37ebec20fef1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097] added\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097] added
Jul 25 17:40:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c32ec0a-3a4f-4c30-a117-048c310cdf3d]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d03b3-fe95-4820-a7d2-9aaad1188277]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ezqsDLmJ {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ezqsDLmJ" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1ba8b9-6acd-46b9-85e2-0598557e4a0c]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ezqsDLmJ'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[429c907b-df89-44c1-a8cf-1b614998679a]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[126c3d73-b0f1-42d6-a448-f4de8fd6d08d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:40:30 user nova-compute[70659]:  {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 17:40:30 user nova-compute[70659]:  {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:40:30 user nova-compute[70659]: WARNING os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 17:40:30 user nova-compute[70659]: 
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --login {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0e2ce2-aecb-46b7-a394-16fc0ab48728]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097, portal: 172.16.0.220,3260]
Jul 25 17:40:30 user nova-compute[70659]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097, portal: 172.16.0.220,3260] successful.
Jul 25 17:40:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b99263-a414-4871-aebf-5886e5369b85]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d95578-9bf7-4a5a-aa47-fbf19b1cc892]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 (non-flash)
Jul 25 17:40:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 (non-flash)
Jul 25 17:40:30 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Connected to 172.16.0.220:3260 {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=70659) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70659) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[67692781-169a-4853-877e-da250be055c8]: (4, ('- - 0', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:30 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70659) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezqsDLmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70659) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23031313536626538', 'path': '/dev/sdb'} {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031313536626538', 'path': '/dev/sdb'} {{(pid=70659) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG nova.objects.instance [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 17:40:31 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:40:31 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:40:31 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:40:31 user nova-compute[70659]:   <serial>7d0fe06a-4be8-4994-a0aa-acd26d535097</serial>
Jul 25 17:40:31 user nova-compute[70659]: </disk>
Jul 25 17:40:31 user nova-compute[70659]:  {{(pid=70659) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No BDM found with device name vda, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70659) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 17:40:31 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] No VIF found with MAC fa:16:3e:c5:a9:08, not building metadata {{(pid=70659) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 17:40:32 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-98b22abf-c167-449b-9443-64bf577eefaa tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.446s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:40:32 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:33 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70659) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:34 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:40:34 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=25.098384857177734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:40:34 user nova-compute[70659]: INFO nova.compute.manager [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Detaching volume 7d0fe06a-4be8-4994-a0aa-acd26d535097
Jul 25 17:40:34 user nova-compute[70659]: INFO nova.virt.block_device [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Attempting to driver detach volume 7d0fe06a-4be8-4994-a0aa-acd26d535097 from mountpoint /dev/vdb
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Attempting to detach device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the persistent domain config. {{(pid=70659) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:40:34 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:40:34 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:40:34 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:40:34 user nova-compute[70659]:   <serial>7d0fe06a-4be8-4994-a0aa-acd26d535097</serial>
Jul 25 17:40:34 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:40:34 user nova-compute[70659]: </disk>
Jul 25 17:40:34 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:40:34 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully detached device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the persistent domain config.
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the live domain config. {{(pid=70659) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.guest [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 17:40:34 user nova-compute[70659]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 17:40:34 user nova-compute[70659]:   <source dev="/dev/sdb"/>
Jul 25 17:40:34 user nova-compute[70659]:   <target dev="vdb" bus="virtio"/>
Jul 25 17:40:34 user nova-compute[70659]:   <serial>7d0fe06a-4be8-4994-a0aa-acd26d535097</serial>
Jul 25 17:40:34 user nova-compute[70659]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 17:40:34 user nova-compute[70659]: </disk>
Jul 25 17:40:34 user nova-compute[70659]:  {{(pid=70659) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-f46683cd-2861-421f-9369-8c99a381897a None None] Received event <DeviceRemovedEvent: 1690306834.577978, a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70659) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.driver [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 17:40:34 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully detached device vdb from instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 from the live domain config.
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] calling os-brick to detach iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdd304e2710>, {'target_iqns': ['iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezqsDLmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 17:40:34 user nova-compute[70659]: WARNING os_brick.initiator.connectors.base [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097', 0)] {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[515b597c-89c6-42a8-8f8d-804145ca9c27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f170e0-dfcb-470a-b95d-392013ebffe5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 (non-flash)\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 (non-flash)
Jul 25 17:40:34 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 (non-flash)
Jul 25 17:40:34 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd1076f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097'): ({'sdb'}, set())}) {{(pid=70659) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Removing single pathed devices sdb {{(pid=70659) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b0b9dc-48db-46f3-b548-9c7f562a9b99]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[101e17cc-ca5d-49db-ba27-f96d04430ca1]: (4, ('ok\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Flushing IO for device /dev/sdb {{(pid=70659) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b59920-f401-4843-bd3b-261837599ab4]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70659) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d02022-5979-46fa-8a41-9984bdf2f077]: (4, ('1', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.linuxscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] SCSI volumes sdb have been removed. {{(pid=70659) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097')] {{(pid=70659) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b96bafe-6426-44d3-b3ef-ca902f75e3b5]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --logout {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[22de07ba-8632-4790-923d-ea84c5916f15]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097, portal: 172.16.0.220,3260]
Jul 25 17:40:34 user nova-compute[70659]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097, portal: 172.16.0.220,3260] successful.
Jul 25 17:40:34 user nova-compute[70659]:  stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op delete {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0fe06a-4be8-4994-a0aa-acd26d535097 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81811) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG oslo.privsep.daemon [-] privsep: reply[de22f3c2-ea8f-41fb-b1ef-9d14e638f44e]: (4, ('', '')) {{(pid=81811) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70659) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.base [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG os_brick.initiator.connectors.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] <== disconnect_volume: return (262ms) None {{(pid=70659) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 17:40:34 user nova-compute[70659]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Disconnected iSCSI Volume {{(pid=70659) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 17:40:35 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:40:35 user nova-compute[70659]: DEBUG nova.objects.instance [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'flavor' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:40:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-e033cf44-f092-4dc9-974d-ec6ed0d34db3 tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.583s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:40:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:40 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:40 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:40:45 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:40:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:40:48 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:40:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:40:48 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:40:48 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:40:48 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:40:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:40:49 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:40:49 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:40:49 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:40:54 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:40:59 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:04 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:41:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:41:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:41:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:41:09 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:14 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:19 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:24 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:41:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:27 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:29 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:31 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:33 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 17:41:34 user nova-compute[70659]: DEBUG oslo_concurrency.processutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70659) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 17:41:35 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:41:35 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:41:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.097511291503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:41:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70659) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 17:41:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:41:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:41:35 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:41:35 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:41:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:41:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:36 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:36 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:41:37 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:39 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:44 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:47 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:41:50 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:41:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:41:50 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:41:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 17:41:50 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquired lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 17:41:50 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Forcefully refreshing network info cache for instance {{(pid=70659) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 17:41:50 user nova-compute[70659]: DEBUG nova.objects.instance [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lazy-loading 'info_cache' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG nova.network.neutron [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [{"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Releasing lock "refresh_cache-a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" {{(pid=70659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updated the network info_cache for instance {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:51 user nova-compute[70659]: INFO nova.compute.manager [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Terminating instance
Jul 25 17:41:51 user nova-compute[70659]: DEBUG nova.compute.manager [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Start destroying the instance on the hypervisor. {{(pid=70659) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG nova.compute.manager [req-76bde961-e214-48ba-927e-670299819de3 req-773c13fc-7b30-46b7-a811-26b6696d3abe service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-unplugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-76bde961-e214-48ba-927e-670299819de3 req-773c13fc-7b30-46b7-a811-26b6696d3abe service nova] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-76bde961-e214-48ba-927e-670299819de3 req-773c13fc-7b30-46b7-a811-26b6696d3abe service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-76bde961-e214-48ba-927e-670299819de3 req-773c13fc-7b30-46b7-a811-26b6696d3abe service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG nova.compute.manager [req-76bde961-e214-48ba-927e-670299819de3 req-773c13fc-7b30-46b7-a811-26b6696d3abe service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] No waiting events found dispatching network-vif-unplugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:41:51 user nova-compute[70659]: DEBUG nova.compute.manager [req-76bde961-e214-48ba-927e-670299819de3 req-773c13fc-7b30-46b7-a811-26b6696d3abe service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-unplugged-625f266b-2591-4cf1-a454-b753ac3ed5aa for instance with task_state deleting. {{(pid=70659) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:52 user nova-compute[70659]: INFO nova.virt.libvirt.driver [-] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Instance destroyed successfully.
Jul 25 17:41:52 user nova-compute[70659]: DEBUG nova.objects.instance [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lazy-loading 'resources' on Instance uuid a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 {{(pid=70659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG nova.virt.libvirt.vif [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T17:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-435911274',display_name='tempest-SnapshotDataIntegrityTests-server-435911274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-435911274',id=52,image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9VDREs+EtMOSA4c21s9+0O+7NycTXxrSp9+EeOZym5A7sGp34I8VR9fx2mxVk9r7kI0nFgkzb8HkyUZIlQfj9H6BMat0qparV+4tS18ash9haaiJRxu0PAsBCXU+gVSw==',key_name='tempest-keypair-1681928316',keypairs=<?>,launch_index=0,launched_at=2023-07-25T17:35:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91a384cb0a5441f3a20d33605712e3fe',ramdisk_id='',reservation_id='r-no2xyoak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf818516-7014-4487-8846-a63b84aa1a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1769443324',owner_user_name='tempest-SnapshotDataIntegrityTests-1769443324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T17:35:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd48404544f646a5a2fad0f9116ec6ad',uuid=a0f5f3b5-c497-4e20-9d91-cb9e20da6e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Converting VIF {"id": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "address": "fa:16:3e:c5:a9:08", "network": {"id": "976a1c4a-2f56-435b-9f9d-7ebb275f46da", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-773790600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91a384cb0a5441f3a20d33605712e3fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625f266b-25", "ovs_interfaceid": "625f266b-2591-4cf1-a454-b753ac3ed5aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG nova.network.os_vif_util [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a9:08,bridge_name='br-int',has_traffic_filtering=True,id=625f266b-2591-4cf1-a454-b753ac3ed5aa,network=Network(976a1c4a-2f56-435b-9f9d-7ebb275f46da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625f266b-25') {{(pid=70659) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG os_vif [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a9:08,bridge_name='br-int',has_traffic_filtering=True,id=625f266b-2591-4cf1-a454-b753ac3ed5aa,network=Network(976a1c4a-2f56-435b-9f9d-7ebb275f46da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625f266b-25') {{(pid=70659) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap625f266b-25, bridge=br-int, if_exists=True) {{(pid=70659) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:41:52 user nova-compute[70659]: INFO os_vif [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:a9:08,bridge_name='br-int',has_traffic_filtering=True,id=625f266b-2591-4cf1-a454-b753ac3ed5aa,network=Network(976a1c4a-2f56-435b-9f9d-7ebb275f46da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625f266b-25')
Jul 25 17:41:52 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Deleting instance files /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52_del
Jul 25 17:41:52 user nova-compute[70659]: INFO nova.virt.libvirt.driver [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Deletion of /opt/stack/data/nova/instances/a0f5f3b5-c497-4e20-9d91-cb9e20da6e52_del complete
Jul 25 17:41:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:52 user nova-compute[70659]: INFO nova.compute.manager [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 25 17:41:52 user nova-compute[70659]: DEBUG oslo.service.loopingcall [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70659) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG nova.compute.manager [-] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Deallocating network for instance {{(pid=70659) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 17:41:52 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] deallocate_for_instance() {{(pid=70659) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG nova.network.neutron [-] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Updating instance_info_cache with network_info: [] {{(pid=70659) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 17:41:53 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Took 1.22 seconds to deallocate network for instance.
Jul 25 17:41:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG nova.compute.manager [req-0d3d824b-9cf9-4b54-aa1c-247e8e4502a1 req-a4032872-3f28-4b6e-823e-b5bfd8633aaf service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-deleted-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:41:53 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:53 user nova-compute[70659]: INFO nova.scheduler.client.report [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Deleted allocations for instance a0f5f3b5-c497-4e20-9d91-cb9e20da6e52
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] No waiting events found dispatching network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:41:54 user nova-compute[70659]: WARNING nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received unexpected event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa for instance with vm_state deleted and task_state None.
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] No waiting events found dispatching network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:41:54 user nova-compute[70659]: WARNING nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received unexpected event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa for instance with vm_state deleted and task_state None.
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] No waiting events found dispatching network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:41:54 user nova-compute[70659]: WARNING nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received unexpected event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa for instance with vm_state deleted and task_state None.
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-unplugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] No waiting events found dispatching network-vif-unplugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:41:54 user nova-compute[70659]: WARNING nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received unexpected event network-vif-unplugged-625f266b-2591-4cf1-a454-b753ac3ed5aa for instance with vm_state deleted and task_state None.
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Acquiring lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:54 user nova-compute[70659]: DEBUG nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] No waiting events found dispatching network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa {{(pid=70659) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 17:41:54 user nova-compute[70659]: WARNING nova.compute.manager [req-b10a016a-351e-4a7d-bf6e-22daefbc3069 req-8749d77f-2fb4-478a-badf-ab8cc6cd1f91 service nova] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Received unexpected event network-vif-plugged-625f266b-2591-4cf1-a454-b753ac3ed5aa for instance with vm_state deleted and task_state None.
Jul 25 17:41:54 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-d509ee91-98c0-4e36-ace6-0f2829b5976e tempest-SnapshotDataIntegrityTests-1769443324 tempest-SnapshotDataIntegrityTests-1769443324-project-member] Lock "a0f5f3b5-c497-4e20-9d91-cb9e20da6e52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.464s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:41:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:42:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:42:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:42:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:42:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:07 user nova-compute[70659]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690306912.4239697, a0f5f3b5-c497-4e20-9d91-cb9e20da6e52 => Stopped> {{(pid=70659) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 17:42:07 user nova-compute[70659]: INFO nova.compute.manager [-] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] VM Stopped (Lifecycle Event)
Jul 25 17:42:07 user nova-compute[70659]: DEBUG nova.compute.manager [None req-614de164-2694-44f6-9917-5a6e47542514 None None] [instance: a0f5f3b5-c497-4e20-9d91-cb9e20da6e52] Checking state {{(pid=70659) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 17:42:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:42:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:42:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:42:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:42:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:42:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:42:12 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:17 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:42:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:42:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:42:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:42:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:42:22 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:25 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:27 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:42:29 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:32 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:33 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:34 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:34 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 17:42:34 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] There are 0 instances to clean {{(pid=70659) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70659) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Auditing locally available compute resources for user (node: user) {{(pid=70659) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 17:42:35 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:42:35 user nova-compute[70659]: WARNING nova.virt.libvirt.driver [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 17:42:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=25.124584197998047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70659) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70659) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG nova.compute.provider_tree [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed in ProviderTree for provider: 9f90033f-5d23-4363-83e3-e56f7852cf56 {{(pid=70659) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG nova.scheduler.client.report [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Inventory has not changed for provider 9f90033f-5d23-4363-83e3-e56f7852cf56 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70659) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG nova.compute.resource_tracker [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Compute_service record updated for user:user {{(pid=70659) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 17:42:35 user nova-compute[70659]: DEBUG oslo_concurrency.lockutils [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=70659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 17:42:37 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:42:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:42 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:42 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:44 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:45 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:47 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:48 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:49 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:52 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:42:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Starting heal instance info cache {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 17:42:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Rebuilding the list of instances to heal {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 17:42:52 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Didn't find any instances for network info cache update. {{(pid=70659) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 17:42:52 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:57 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:42:59 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:43:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:43:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:43:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:43:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:43:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:43:02 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:43:05 user nova-compute[70659]: DEBUG oslo_service.periodic_task [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70659) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 17:43:05 user nova-compute[70659]: DEBUG nova.compute.manager [None req-1d5e27c2-1c6f-4db8-8e0f-d6bfc48261f1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70659) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 17:43:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 17:43:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 17:43:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70659) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 17:43:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:43:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70659) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 17:43:07 user nova-compute[70659]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70659) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}